-- Logs begin at Fri 2022-08-12 10:08:44 UTC, end at Fri 2022-08-12 11:08:06 UTC. -- Aug 12 10:41:59.424626 dv-cinder-852945-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 10:41:59.433972 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 10:41:59 2022] *** Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: nodename: dv-cinder-852945-1-iscsi Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: machine: x86_64 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: clock source: unix Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: pcre jit disabled Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: detected number of CPU cores: 4 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: current working directory: / Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: detected binary path: /usr/bin/uwsgi-core Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: your processes number limit is 47680 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: your memory page size is 4096 bytes Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: detected max file descriptor number: 2048 Aug 12 10:41:59.436679 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: lock engine: pthread robust mutexes Aug 12 10:41:59.437616 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: thunder lock: enabled Aug 12 10:41:59.437616 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 10:41:59.437616 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 10:41:59.478260 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: Python main interpreter initialized at 0x564e36e499c0 Aug 12 10:41:59.478260 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: python threads support enabled Aug 12 10:41:59.478260 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: your server socket listen backlog is limited to 100 connections Aug 12 10:41:59.478260 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: your mercy for graceful operations on workers is 90 seconds Aug 12 10:41:59.478620 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 10:41:59.478620 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: *** Operational MODE: preforking *** Aug 12 10:41:59.478919 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: *** uWSGI is running in multiple interpreter mode *** Aug 12 10:41:59.478919 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: spawned uWSGI master process (pid: 117154) Aug 12 10:41:59.479115 dv-cinder-852945-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 10:41:59.480147 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: spawned uWSGI worker 1 (pid: 117155, cores: 1) Aug 12 10:41:59.480147 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: spawned uWSGI worker 2 (pid: 117156, cores: 1) Aug 12 10:41:59.480147 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 10:42:00.130289 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 10:42:00.130927 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 10:42:01.203042 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:42:01.203042 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: from cryptography.utils import int_from_bytes Aug 12 10:42:01.203731 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:42:01.203731 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: from cryptography.utils import int_from_bytes Aug 12 10:42:01.204990 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:42:01.204990 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: from cryptography.utils import int_from_bytes Aug 12 10:42:01.205438 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:42:01.205438 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: from cryptography.utils import int_from_bytes Aug 12 10:42:03.669322 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:42:03.669888 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:42:03.670229 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:42:03.670329 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:42:03.670400 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:42:03.670473 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:42:03.670540 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:42:03.670612 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:42:03.670679 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:42:03.670752 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:42:03.671063 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.671205 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.671362 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.671469 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.671713 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.671860 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672034 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672202 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672376 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672489 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672710 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.672840 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673001 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673092 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673349 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673588 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673675 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673743 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.673999 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674230 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674367 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674539 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852945-1-iscsi {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674638 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852945-1-iscsi {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674858 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.674946 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675160 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675255 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675472 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675561 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675787 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.675875 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676092 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676192 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676434 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676523 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676740 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.676828 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.677232 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.677666 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.677666 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.677828 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.677963 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678049 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678266 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678405 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678587 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678705 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.678915 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679007 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679307 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679418 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679581 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679672 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679887 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.679987 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.680209 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.680355 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.680546 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.680642 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.680940 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852945-1-iscsi {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681034 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852945-1-iscsi {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681253 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681347 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681564 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681652 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.681880 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682025 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682283 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682384 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682597 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682695 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682900 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.682988 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683217 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683305 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683537 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683633 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683843 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.683930 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684280 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684495 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684593 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684811 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.684896 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685127 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685210 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685432 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685526 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685740 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.685829 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686042 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686128 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686359 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686444 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686660 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686743 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.686961 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687043 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687208 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687291 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687513 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687596 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687833 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.687919 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688151 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688242 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688501 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688588 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688755 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.688922 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689025 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689117 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689307 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689406 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689622 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689718 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.689929 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690022 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690235 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690328 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690538 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690640 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.690930 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691143 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691236 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691444 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691537 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691747 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.691841 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692050 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692142 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692390 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692495 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692707 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.692800 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693028 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693129 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693333 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693437 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693650 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.693753 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694039 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694141 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694289 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694390 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694593 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694686 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.694963 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695080 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695284 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695415 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695592 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695733 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.695910 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696052 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696233 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696387 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696565 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696697 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.696872 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697005 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697177 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697313 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697495 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697629 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697830 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.697957 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698134 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698263 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698385 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698513 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698687 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698815 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.698993 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699122 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699440 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699610 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699746 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.699912 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700052 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700218 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700386 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700545 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700687 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700852 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.700994 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701155 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701300 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701460 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701607 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701766 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.701915 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702068 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702219 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702389 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702526 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702677 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702815 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.702986 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703123 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703290 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703429 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703608 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703747 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.703929 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704072 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704234 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704385 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704559 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704866 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.704996 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705301 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705496 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705620 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705799 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.705925 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706104 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706231 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706422 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706550 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706728 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.706855 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707032 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707158 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707352 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707476 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707658 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707792 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.707962 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708097 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708295 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708457 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708601 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708760 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.708907 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709066 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709224 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709382 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709529 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709687 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709835 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.709993 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.710136 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.710294 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.710487 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.710810 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711002 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711085 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711163 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711389 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711483 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711689 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711772 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.711983 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712066 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712298 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712384 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712623 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712719 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.712931 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713013 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713239 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713333 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713544 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713628 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713851 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.713943 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.714171 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:42:03.714269 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.714499 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.714583 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.714829 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.714918 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715152 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715239 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715475 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715558 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715804 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.715904 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716123 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716207 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716460 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716547 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716772 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.716864 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717085 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717176 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717395 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717478 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717707 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.717849 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718021 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718106 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718331 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718413 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718644 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718728 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.718960 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719053 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719276 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719359 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719593 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719685 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719905 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.719997 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720212 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720321 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720549 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720871 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.720964 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721269 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721499 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721585 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721807 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.721891 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722148 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722232 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722465 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722792 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.722884 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723106 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723188 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723419 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723512 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723729 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.723813 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724037 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724130 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724370 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724505 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724696 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.724823 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725007 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725144 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725331 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725459 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725646 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725779 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.725984 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726128 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726293 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726428 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726601 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726728 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.726917 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727053 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727232 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727368 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727570 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727708 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.727887 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728022 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728215 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728393 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728555 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728682 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728865 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.728991 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729178 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729486 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729610 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729795 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.729927 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730099 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730229 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730403 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730488 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730710 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.730794 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731013 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731095 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731316 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731399 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731639 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731724 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.731942 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732025 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732282 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732380 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732591 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732674 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.732903 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733035 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733214 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733349 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733523 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733660 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733829 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.733963 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734133 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734267 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734441 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734575 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734746 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.734872 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735050 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735188 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735373 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735498 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735677 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735805 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.735980 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736112 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736323 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736454 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736633 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736760 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.736939 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737067 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737248 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737374 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737557 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737701 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.737866 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738010 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738179 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738314 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738494 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738619 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.738804 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739163 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739453 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739453 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739710 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739844 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.739999 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740085 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740162 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740364 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740464 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740693 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.740778 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741016 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741108 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741318 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741409 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741671 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741761 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.741985 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742119 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742289 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742433 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742596 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742725 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.742902 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743038 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743213 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743345 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743517 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743651 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743822 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.743957 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744125 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744288 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744454 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744591 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744760 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.744914 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745083 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745231 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745392 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745535 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745696 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.745842 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746002 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746147 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746306 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746490 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746649 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746796 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.746957 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747139 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747298 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747474 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747633 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747793 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.747956 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748119 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748301 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748468 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748609 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748786 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.748914 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749096 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749406 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749533 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749749 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.749883 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750013 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750143 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750320 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750456 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750630 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750765 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.750949 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751083 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751259 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751400 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751582 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751720 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.751892 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752019 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752208 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752367 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752537 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752669 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.752853 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753009 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753185 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753284 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753516 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753600 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753829 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.753912 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754148 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754245 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754456 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754577 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754767 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.754860 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755073 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755158 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755379 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755462 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755686 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755772 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.755991 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756075 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756328 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756417 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756638 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756723 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.756950 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757035 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757291 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757437 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757609 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757694 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.757921 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758043 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758275 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758367 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758578 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758663 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.758976 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759216 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759300 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759550 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759683 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759863 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.759948 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760169 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760252 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760525 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760621 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760836 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.760934 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.761464 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.761560 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.761774 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.761866 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762079 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762162 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762382 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762465 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762689 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.762773 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763130 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763311 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763395 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763618 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763702 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.763921 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764005 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764232 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764344 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764566 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764687 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764872 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.764963 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765179 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765271 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765486 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765570 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765804 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.765886 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766110 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766194 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766429 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766522 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766746 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.766836 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767052 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767144 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767356 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767447 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767677 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767760 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.767986 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768076 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768309 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768407 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768617 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768707 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.768921 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769013 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769259 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769343 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769570 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769653 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769871 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.769971 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770189 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770305 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770506 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770602 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770812 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.770907 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771120 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771213 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771429 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771550 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771735 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.771841 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772054 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772154 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772388 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772484 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772696 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.772790 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773061 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773472 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773565 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773786 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.773875 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774098 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774185 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774427 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774522 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774743 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.774845 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775050 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775144 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775358 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775452 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775663 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775747 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.775970 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.776054 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.776303 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.776408 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.776874 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.776962 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777204 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777287 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777521 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777617 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777838 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.777921 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778157 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778241 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778471 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778561 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778796 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.778890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779119 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779203 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779452 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779547 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779754 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.779849 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780063 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780389 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780488 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.780788 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781086 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781305 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781389 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781612 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781718 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.781913 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782017 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782219 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782313 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782520 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782614 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782820 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.782914 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783120 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783213 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783420 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783512 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783729 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.783822 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784028 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784121 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784359 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784457 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784662 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784756 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.784985 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785090 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785292 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785393 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785590 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785683 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785893 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.785997 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786190 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786283 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786529 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786626 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786829 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.786932 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787162 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787257 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787487 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787572 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787825 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.787919 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.788136 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.788224 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.788621 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.788740 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.788958 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789083 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789218 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789519 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.789862 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790131 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790222 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790411 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790539 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790717 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.790858 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791025 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791158 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791334 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791462 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791647 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791802 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.791956 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792082 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792277 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792412 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792586 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792731 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.792889 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793016 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793202 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793355 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793508 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793635 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793813 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.793939 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794114 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794240 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794419 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794544 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794724 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.794850 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795032 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795163 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795337 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795463 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795635 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795766 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.795940 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796073 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796243 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796362 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796570 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796655 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796875 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.796971 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797179 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797262 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797484 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797575 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797786 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.797883 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798088 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798171 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798402 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798492 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798705 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.798807 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799008 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799104 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799308 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799392 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799606 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799698 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799905 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.799990 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800207 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800312 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800550 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800637 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800864 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.800948 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801166 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801257 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801472 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801556 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801770 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.801853 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802072 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802154 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802372 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802455 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802676 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802759 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.802978 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803135 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803280 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803363 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803580 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803663 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803880 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.803971 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.804220 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.804364 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.804559 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.804714 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.804844 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805058 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805379 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805464 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805688 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805780 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.805997 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806083 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806302 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806386 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806646 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806740 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.806955 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807041 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807279 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807364 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807601 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807694 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.807915 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808001 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808226 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808333 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808565 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808661 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808869 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.808964 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809189 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809284 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809491 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809590 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809801 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.809885 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810106 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810192 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810410 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810506 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810711 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.810794 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811017 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811102 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811325 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811410 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811637 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811728 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.811948 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812039 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812313 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812405 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812600 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812683 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812912 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.812998 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813213 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813298 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813521 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813603 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813831 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.813915 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814138 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814222 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814445 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814529 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814750 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.814841 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815064 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815148 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815374 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815457 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815680 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815771 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.815985 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816069 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816399 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816619 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816718 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.816923 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817006 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817229 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817311 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817533 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817626 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817833 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.817916 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818140 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818444 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818530 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818750 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.818877 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819050 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819146 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819358 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819473 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819663 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.819863 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820227 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820329 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820574 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820682 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820886 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.820972 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821198 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821290 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821513 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821600 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821828 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.821922 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822137 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822230 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822451 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822555 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.822868 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823181 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823274 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823486 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823570 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823790 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.823875 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824093 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824186 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824419 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824505 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824727 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.824813 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825039 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825134 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825343 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825428 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825645 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825729 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.825948 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826033 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826254 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826339 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826573 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826657 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826879 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.826992 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.827200 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.827310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.827617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.827705 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.827934 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828028 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828242 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828379 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828648 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828742 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.828970 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829056 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829277 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829403 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829600 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829692 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.829907 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830000 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830218 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830399 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830526 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830612 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830813 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.830909 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831122 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831208 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831437 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831521 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831750 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.831848 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832056 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832148 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832391 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832492 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832696 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.832791 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833011 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833096 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833330 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833413 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833643 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833741 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.833963 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834047 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834339 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834431 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834659 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834744 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.834969 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835052 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835283 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835411 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835646 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835767 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.835951 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836104 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836248 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836373 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836579 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836672 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836880 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.836964 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837186 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837280 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837495 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837579 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837803 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.837889 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838111 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838205 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838413 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838499 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838714 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.838800 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839019 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839110 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839321 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839407 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839640 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839734 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.839945 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840038 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840317 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840419 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840599 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840684 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840899 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.840991 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841221 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841305 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841526 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841663 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841825 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.841925 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842127 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842233 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842518 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842728 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.842823 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843033 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843135 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843352 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843447 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843663 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843756 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.843984 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844078 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844313 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844646 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844734 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.844952 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845037 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845280 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845373 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845598 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845683 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845912 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.845997 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846216 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846519 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846605 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846827 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.846920 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847128 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847221 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847431 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847532 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847730 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.847823 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848027 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848112 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848351 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848441 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848655 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848739 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.848957 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849058 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849257 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849353 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849562 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849708 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.849915 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850058 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850191 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850329 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850461 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850590 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850747 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.850879 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851066 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851240 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851381 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851477 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851660 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851790 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.851989 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852115 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852311 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852414 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852635 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852720 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.852944 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853106 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853255 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853356 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853567 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853651 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853877 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.853967 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854187 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854279 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854494 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854578 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854802 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.854885 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855110 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855196 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855420 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855503 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855727 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.855819 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856038 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856122 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856369 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856587 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856673 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.856919 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857191 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857280 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857525 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857625 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857838 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.857933 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858148 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858233 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858455 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858542 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858765 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.858863 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859072 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859157 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859382 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859468 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859690 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.859781 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860000 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860085 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860334 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860425 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860662 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860761 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.860982 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861068 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861296 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861387 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861611 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861698 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.861926 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862011 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862237 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862322 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862552 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862647 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862865 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.862957 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863270 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863494 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863580 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863807 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.863891 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864116 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864212 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864452 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864539 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864762 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.864846 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865066 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865159 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865372 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865457 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865681 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865766 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.865987 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866072 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866295 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866379 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866616 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866707 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.866954 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867055 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867264 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867355 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867586 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867680 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867895 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.867991 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.868205 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.868322 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.868545 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.868639 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.868858 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869063 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869170 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869378 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869685 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869813 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.869999 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870092 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870329 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870446 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870644 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870754 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.870961 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871064 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871275 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871369 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871576 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871680 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871882 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.871975 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872186 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872307 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872517 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872612 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872818 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.872903 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873121 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873204 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873423 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873509 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873721 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.873813 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874035 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874119 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874339 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874423 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874654 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874879 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.874965 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.875223 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.875479 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.875573 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.875824 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.875910 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876140 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876234 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876480 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876566 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876786 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.876880 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877105 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877199 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877408 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877493 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877712 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.877804 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878020 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878112 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878323 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878409 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878623 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878707 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.878925 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879011 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879228 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879312 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879534 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879638 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879835 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.879975 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880141 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880226 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880466 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880551 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880772 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.880858 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881076 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881373 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881458 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881679 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881766 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.881982 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882074 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882460 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882613 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882721 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.882916 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883027 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883219 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883333 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883529 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883623 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883832 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.883924 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884139 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884237 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884471 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884560 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884785 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.884883 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885089 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885183 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885397 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885482 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885699 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.885784 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.886313 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.886406 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.886625 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.886711 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.886947 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887041 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887252 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887338 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887565 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887649 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887888 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.887980 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888198 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888317 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888528 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888625 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888848 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.888940 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.889157 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.889243 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.889498 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.889691 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.889816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890026 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890346 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890432 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890674 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890758 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.890988 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891098 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891298 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891399 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891604 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891696 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.891910 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892005 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892209 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892322 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892554 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892646 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892863 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.892965 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893170 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893254 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893476 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893559 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893780 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.893864 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894088 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894173 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894392 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894476 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894700 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.894786 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895007 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895103 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895312 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895396 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895614 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895699 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.895919 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896011 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896225 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896340 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896640 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896863 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.896948 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897168 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897261 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897480 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897565 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897803 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.897926 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898167 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898347 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898467 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898548 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898780 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.898874 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899089 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899183 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899395 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899479 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899701 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.899829 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900006 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900129 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900335 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900424 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900653 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900738 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.900983 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.901070 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.901303 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.901445 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.901604 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.901702 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902013 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902096 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902320 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902404 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902631 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902729 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.902947 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903031 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903256 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903340 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903562 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903654 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903884 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.903968 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904190 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904287 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904535 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904622 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904845 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.904937 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905175 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905260 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905510 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905596 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905816 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.905901 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906122 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906207 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906425 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906554 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906724 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.906808 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907027 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907126 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907333 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907418 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907635 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907720 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.907936 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908030 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908235 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908379 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908559 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908644 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908862 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.908960 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909160 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909253 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909460 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909550 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909760 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.909852 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910059 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910150 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910361 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910461 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910657 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910742 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.910959 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911045 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911257 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911341 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911648 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911857 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.911951 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912156 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912240 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912484 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912572 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912782 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.912868 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913080 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913173 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913375 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913483 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913762 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.913890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914072 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914238 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914387 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914473 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914707 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.914801 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915015 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915174 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915331 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915429 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915635 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915726 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.915951 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916045 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916255 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916361 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916592 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916676 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916900 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.916998 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917209 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917303 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917516 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917609 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917822 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.917914 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918132 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918218 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918440 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918523 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918747 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.918832 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919053 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919139 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919407 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919500 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919669 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919756 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.919974 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920057 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920315 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920406 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920623 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920708 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.920939 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921022 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921251 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921344 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921555 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921640 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921870 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.921953 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922176 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922268 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922485 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922570 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922792 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.922892 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923100 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923198 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923404 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923489 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923713 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.923798 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924017 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924102 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924346 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924434 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924655 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924739 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.924964 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925050 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925279 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925363 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925591 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925676 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925895 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.925980 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926218 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926303 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926523 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926616 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926849 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.926938 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927168 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927252 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927510 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927603 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927822 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.927907 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928132 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928216 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928468 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928568 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928774 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.928859 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.929017 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117156) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:42:03.929129 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.929419 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:42:03.929660 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:42:04.082784 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO dbcounter [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Registered counter for database nova_api Aug 12 10:42:04.083874 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO dbcounter [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Registered counter for database nova_api Aug 12 10:42:04.107007 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.108895 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.114972 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writer thread running {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.115860 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writer thread running {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.170875 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.context [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbfddc02-5078-4af6-bce3-a7173079e6ee(cell1) {{(pid=117156) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 10:42:04.171062 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.context [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbfddc02-5078-4af6-bce3-a7173079e6ee(cell1) {{(pid=117155) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 10:42:04.174650 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:42:04.174815 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:42:04.175130 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:42:04.175291 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:42:04.176701 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:42:04.176855 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:42:04.177445 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:42:04.177575 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:42:04.177874 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:42:04.178021 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:42:04.179910 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:42:04.180061 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_concurrency.lockutils [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:42:04.181933 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO dbcounter [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Registered counter for database nova_cell0 Aug 12 10:42:04.182067 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO dbcounter [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Registered counter for database nova_cell0 Aug 12 10:42:04.187332 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO dbcounter [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Registered counter for database nova_cell1 Aug 12 10:42:04.187481 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO dbcounter [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Registered counter for database nova_cell1 Aug 12 10:42:04.195782 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.197781 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.199265 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.201452 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.203515 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writer thread running {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.206058 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writer thread running {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.207835 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writer thread running {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.340577 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writer thread running {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.348726 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO dbcounter [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Registered counter for database nova_cell0 Aug 12 10:42:04.349664 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO dbcounter [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Registered counter for database nova_cell0 Aug 12 10:42:04.360641 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG oslo_db.sqlalchemy.engines [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.362268 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117156) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:42:04.366201 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writer thread running {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.366492 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writer thread running {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:42:04.702895 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: WARNING keystonemiddleware.auth_token [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:42:04.707476 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: WARNING keystonemiddleware.auth_token [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:42:04.710238 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: WARNING keystonemiddleware.auth_token [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:42:04.714694 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: WARNING keystonemiddleware.auth_token [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:42:05.054806 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: WARNING keystonemiddleware.auth_token [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:42:05.056869 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: WARNING keystonemiddleware.auth_token [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:42:05.061025 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: WARNING keystonemiddleware.auth_token [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:42:05.062807 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: WARNING keystonemiddleware.auth_token [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:42:05.066673 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e36e499c0 pid: 117155 (default app) Aug 12 10:42:05.068044 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e36e499c0 pid: 117156 (default app) Aug 12 10:42:05.068883 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:42:05.070126 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-2c7bf915-2526-4caa-aa14-7c8d25b4815a None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001815 Aug 12 10:42:05.070531 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Fri Aug 12 10:42:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:23.433162 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:23.434369 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Aug 12 10:43:23.434732 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 1/2] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:23.446357 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_api:SELECT=3 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:23.447452 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_cell1:SELECT=3 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:23.448565 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_cell0:SELECT=3 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:23.449367 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:24.315067 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-44a658c0-d227-4257-8932-053e73231d0c admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:24.349372 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-44a658c0-d227-4257-8932-053e73231d0c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.908460 Aug 12 10:43:24.349893 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Aug 12 10:43:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:26.674880 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:26.675934 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-0fe8f7b7-55ff-41b8-9f6f-7bab37a750ff None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 12 10:43:26.676423 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 2/4] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:27.098552 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-9fa9f019-550c-4b24-bb97-4b7981953fce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "disk": 1, "vcpus": 1, "swap": 0, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 256}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:27.118890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:27.118890 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: warnings.warn(msg) Aug 12 10:43:27.148747 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-9fa9f019-550c-4b24-bb97-4b7981953fce admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.466333 Aug 12 10:43:27.149803 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 3/5] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:27.370290 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-e5c8c8c1-faba-435c-90cd-a0bbf134a776 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:27.374707 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:27.374707 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:43:27.377526 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_api:SELECT=3 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:27.378444 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_cell0:SELECT=3 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:27.379452 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_cell1:SELECT=3 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:27.380722 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:27.440348 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-e5c8c8c1-faba-435c-90cd-a0bbf134a776 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282069 Aug 12 10:43:27.444907 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 3/6] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Aug 12 10:43:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:29.779517 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-9fa9f019-550c-4b24-bb97-4b7981953fce admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:29.780882 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-9fa9f019-550c-4b24-bb97-4b7981953fce admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Aug 12 10:43:29.781575 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 4/7] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:30.433831 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-6c6b19f8-5d25-4fa5-b04d-b98232c748b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "id": "d1", "disk": 5, "ram": 512, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:30.453232 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:30.453232 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:43:30.474388 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-6c6b19f8-5d25-4fa5-b04d-b98232c748b5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686042 Aug 12 10:43:30.475164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 4/8] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:30.488106 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-19dd8cd8-9b33-4a8e-adaf-8353f18cedb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:30.491404 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:43:30.491404 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: warnings.warn(msg) Aug 12 10:43:30.526620 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-19dd8cd8-9b33-4a8e-adaf-8353f18cedb8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042418 Aug 12 10:43:30.527467 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 5/9] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Aug 12 10:43:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (3 switches on core 0) Aug 12 10:43:32.854962 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-6c6b19f8-5d25-4fa5-b04d-b98232c748b5 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:32.855898 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-6c6b19f8-5d25-4fa5-b04d-b98232c748b5 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 12 10:43:32.856310 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 5/10] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:33.255792 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-3b0fbf2f-8283-463e-9885-730151220965 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:33.275438 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-3b0fbf2f-8283-463e-9885-730151220965 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.412670 Aug 12 10:43:33.275992 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 6/11] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:33.288566 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-dbabaa38-078b-4b42-9b2d-a63d6346cf1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:33.314608 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-dbabaa38-078b-4b42-9b2d-a63d6346cf1d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030135 Aug 12 10:43:33.315214 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 6/12] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Aug 12 10:43:33 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:43:35.669513 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-3b0fbf2f-8283-463e-9885-730151220965 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:35.670509 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-3b0fbf2f-8283-463e-9885-730151220965 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 12 10:43:35.670906 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 7/13] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:36.115220 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d7b7ed53-8dc6-491e-8212-01ca78e1f68e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "ram": 2048, "id": "d3", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:36.136701 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d7b7ed53-8dc6-491e-8212-01ca78e1f68e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.459437 Aug 12 10:43:36.137719 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 7/14] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:36.149886 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-b175ba4c-d9e1-45ab-b47c-a3496a22fed8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:36.174313 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-b175ba4c-d9e1-45ab-b47c-a3496a22fed8 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028170 Aug 12 10:43:36.188369 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 8/15] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Aug 12 10:43:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:38.504741 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d7b7ed53-8dc6-491e-8212-01ca78e1f68e admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:38.505959 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d7b7ed53-8dc6-491e-8212-01ca78e1f68e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001779 Aug 12 10:43:38.506721 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 8/16] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:38.940818 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "name": "ds4G", "disk": 20, "id": "d4", "ram": 4096}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:38.960958 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.447244 Aug 12 10:43:38.961722 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 9/17] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:38.974096 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-ae50257e-ddf4-4f40-b49e-c6a7c3283958 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:38.998519 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-ae50257e-ddf4-4f40-b49e-c6a7c3283958 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028139 Aug 12 10:43:38.999220 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 9/18] 10.222.0.23 () {64 vars in 1336 bytes} [Fri Aug 12 10:43:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:41.787373 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:41.788747 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001977 Aug 12 10:43:41.789424 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 10/19] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:42.202120 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-c77c097b-ecac-4734-84c1-f70a2dd4ee35 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:42.226599 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-c77c097b-ecac-4734-84c1-f70a2dd4ee35 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430609 Aug 12 10:43:42.227175 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 10/20] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Aug 12 10:43:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:43:45.433251 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:45.434277 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-69bdf2b2-7352-4acf-a719-31d7b3b9b351 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 12 10:43:45.434693 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 11/21] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:43:45.839769 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-2cacd06c-e38f-478c-bced-2cf8d570ac85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "disk": 1, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:45.861553 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-2cacd06c-e38f-478c-bced-2cf8d570ac85 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.420510 Aug 12 10:43:45.862062 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 11/22] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:45.874205 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-b410193f-033d-4240-ae55-d1bd24c3593a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:45.899675 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-b410193f-033d-4240-ae55-d1bd24c3593a admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029218 Aug 12 10:43:45.900282 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 12/23] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Aug 12 10:43:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:48.198385 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-2cacd06c-e38f-478c-bced-2cf8d570ac85 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:48.199292 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-2cacd06c-e38f-478c-bced-2cf8d570ac85 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 12 10:43:48.199690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 12/24] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:48.581486 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-41da0888-1ab1-4b31-80a3-82f025937f58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:48.601343 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-41da0888-1ab1-4b31-80a3-82f025937f58 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.395313 Aug 12 10:43:48.602105 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 13/25] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:48.614223 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-a5732b39-d05f-4157-b59d-b3b236941d0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:48.639824 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-a5732b39-d05f-4157-b59d-b3b236941d0d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029243 Aug 12 10:43:48.640435 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 13/26] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Aug 12 10:43:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:50.977653 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-41da0888-1ab1-4b31-80a3-82f025937f58 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:50.979335 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-41da0888-1ab1-4b31-80a3-82f025937f58 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002112 Aug 12 10:43:50.980156 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 14/27] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:51.454281 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-2e06a4e4-6b28-4431-ab0c-f0d66a6f3dac admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "name": "m1.medium", "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:51.481217 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-2e06a4e4-6b28-4431-ab0c-f0d66a6f3dac admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.494791 Aug 12 10:43:51.482212 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 14/28] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:51.493967 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-964f409c-a31c-457c-bbe6-eb807a77d53d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:51.529416 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-964f409c-a31c-457c-bbe6-eb807a77d53d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038920 Aug 12 10:43:51.530168 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 15/29] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Aug 12 10:43:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:43:53.923563 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-2e06a4e4-6b28-4431-ab0c-f0d66a6f3dac admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:53.924622 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-2e06a4e4-6b28-4431-ab0c-f0d66a6f3dac admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 12 10:43:53.925237 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 15/30] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:54.362000 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-4e85b392-3193-4161-8872-373f75994b73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:54.368923 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:43:54.386290 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-4e85b392-3193-4161-8872-373f75994b73 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.452520 Aug 12 10:43:54.387490 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 16/31] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:43:54.399831 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-0e329dd6-c107-47ae-abf9-d517967d734c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:54.424859 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-0e329dd6-c107-47ae-abf9-d517967d734c admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029051 Aug 12 10:43:54.425607 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 16/32] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Aug 12 10:43:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:43:56.752974 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-4e85b392-3193-4161-8872-373f75994b73 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:43:56.754677 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-4e85b392-3193-4161-8872-373f75994b73 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Aug 12 10:43:56.755085 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 17/33] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:43:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:43:57.207378 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:57.229203 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467827 Aug 12 10:43:57.230141 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 17/34] 10.222.0.23 () {64 vars in 1283 bytes} [Fri Aug 12 10:43:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 12 10:43:57.242780 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-8a0b141f-3dbc-4fe3-ac04-ca360be537c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:43:57.284048 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-8a0b141f-3dbc-4fe3-ac04-ca360be537c0 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045554 Aug 12 10:43:57.285165 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 18/35] 10.222.0.23 () {64 vars in 1333 bytes} [Fri Aug 12 10:43:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:44:15.340338 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:15.341750 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 12 10:44:15.342339 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 18/36] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:44:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:15.355572 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:44:15.789636 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-f66b1608-b0a6-4f06-8dde-dd0a1ced9bcb admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:15.807949 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-f66b1608-b0a6-4f06-8dde-dd0a1ced9bcb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456958 Aug 12 10:44:15.808527 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 19/37] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Aug 12 10:44:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:16.880068 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:16.881160 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-eaba0dbd-67d4-46f4-8833-a15f7ad4ec17 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Aug 12 10:44:16.881561 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 19/38] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:17.452061 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-7570895b-0b4d-4da2-9200-0b99d9ed3756 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:17.458389 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.wsgi [None req-7570895b-0b4d-4da2-9200-0b99d9ed3756 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-7570895b-0b4d-4da2-9200-0b99d9ed3756 admin admin] Request method failure captured: Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept: application/json Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept-Encoding: gzip, deflate Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Connection: keep-alive Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Content-Length: 0 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Host: 10.222.0.23 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-System-Scope: None Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: User-Agent: python-novaclient Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Auth-Token: gAAAAABi9i8AxmmTJuZCmpdbLQHMXM30QyU6uRYNrSldcNj1RZdgcRasPVxTYpRWonjIM6PSL_Y69mWpHbe818ard6BK-PkchcaBiW-QjVJItTWU0Zm3__oa5dWvR5eA_PgS60FAf7AqP5JWWuUmbgqe0Pc1Nha9TXbRWTh67ZmJKt9z-csz_-4 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Id: None Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Name: None Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Identity-Status: Confirmed Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Is-Admin-Project: True Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Id: default Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Name: Default Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Name: admin Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Role: reader,admin,member Aug 12 10:44:17.461762 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Roles: reader,admin,member Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant: admin Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Name: admin Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User: admin Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Id: default Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Name: Default Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Name: admin Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: method: > Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: exception: Flavor 42 could not be found. Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: action_args: {'id': '42'} Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:17.463425 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:17.464695 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.465840 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-7570895b-0b4d-4da2-9200-0b99d9ed3756 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:17.466898 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-7570895b-0b4d-4da2-9200-0b99d9ed3756 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.445452 Aug 12 10:44:17.466898 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 20/39] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Aug 12 10:44:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 10:44:17.473164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-2c0898b4-3c83-46ad-a4c9-fcd13979f7b0 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:17.477343 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:44:17.496287 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-2c0898b4-3c83-46ad-a4c9-fcd13979f7b0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026721 Aug 12 10:44:17.496836 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 20/40] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:44:17.506962 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-ad3c8cdb-36bf-4cb0-b9e5-ed2def74fb92 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:17.531667 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-ad3c8cdb-36bf-4cb0-b9e5-ed2def74fb92 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028469 Aug 12 10:44:17.532225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 21/41] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:17.541851 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d3a83927-63ad-4ade-80f4-d9cf49b09068 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:17.548393 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.wsgi [None req-d3a83927-63ad-4ade-80f4-d9cf49b09068 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d3a83927-63ad-4ade-80f4-d9cf49b09068 admin admin] Request method failure captured: Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept: application/json Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept-Encoding: gzip, deflate Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Connection: keep-alive Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Content-Length: 0 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Host: 10.222.0.23 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-System-Scope: None Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: User-Agent: python-novaclient Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Auth-Token: gAAAAABi9i8AxmmTJuZCmpdbLQHMXM30QyU6uRYNrSldcNj1RZdgcRasPVxTYpRWonjIM6PSL_Y69mWpHbe818ard6BK-PkchcaBiW-QjVJItTWU0Zm3__oa5dWvR5eA_PgS60FAf7AqP5JWWuUmbgqe0Pc1Nha9TXbRWTh67ZmJKt9z-csz_-4 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Id: None Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Name: None Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Identity-Status: Confirmed Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Is-Admin-Project: True Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Id: default Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Name: Default Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Name: admin Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Role: reader,admin,member Aug 12 10:44:17.551690 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Roles: reader,admin,member Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant: admin Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Name: admin Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User: admin Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Id: default Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Name: Default Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Name: admin Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: method: > Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: exception: Flavor 42 could not be found. Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: action_args: {'id': '42'} Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:17.553272 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:17.554146 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:17.555186 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d3a83927-63ad-4ade-80f4-d9cf49b09068 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:17.556156 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d3a83927-63ad-4ade-80f4-d9cf49b09068 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014937 Aug 12 10:44:17.556156 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 21/42] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Aug 12 10:44:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 12 10:44:18.538420 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-ad3c8cdb-36bf-4cb0-b9e5-ed2def74fb92 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:18.539439 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-ad3c8cdb-36bf-4cb0-b9e5-ed2def74fb92 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 12 10:44:18.539844 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 22/43] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:19.159390 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-be50809e-d251-4bec-8468-a41f8d4951e8 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:19.166070 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.wsgi [None req-be50809e-d251-4bec-8468-a41f8d4951e8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-be50809e-d251-4bec-8468-a41f8d4951e8 admin admin] Request method failure captured: Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept: application/json Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept-Encoding: gzip, deflate Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Connection: keep-alive Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Content-Length: 0 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Host: 10.222.0.23 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-System-Scope: None Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: User-Agent: python-novaclient Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Auth-Token: gAAAAABi9i8CNnX80t4ru_r0iIkHydSKQKGtiDbTgUCHqYHLX49IXPFppRmlMVPAQsDiavnu7vwfZS0fyrtyYzzOFjAba5azjevAC91qxa9PjoB7RDiyOxD9Pnd8F_OOIv23E8WbN0dA-JAbrP9vfqCiFviyBwDVyWyOL2Z2PZJg5HNB0ttxKWM Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Id: None Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Name: None Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Identity-Status: Confirmed Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Is-Admin-Project: True Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Id: default Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Name: Default Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Name: admin Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Role: reader,admin,member Aug 12 10:44:19.167585 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Roles: reader,admin,member Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant: admin Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Name: admin Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User: admin Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Id: default Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Name: Default Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Name: admin Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: method: > Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: exception: Flavor 84 could not be found. Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: action_args: {'id': '84'} Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:19.169172 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:19.170003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.171178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-be50809e-d251-4bec-8468-a41f8d4951e8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:19.172320 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-be50809e-d251-4bec-8468-a41f8d4951e8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.490415 Aug 12 10:44:19.172320 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 22/44] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Aug 12 10:44:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 492 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 10:44:19.179278 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-f2a9bc1a-f7ab-45f9-8daa-37872b01599a admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:19.194476 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-f2a9bc1a-f7ab-45f9-8daa-37872b01599a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018972 Aug 12 10:44:19.194983 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 23/45] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:19.204630 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d9857ed9-3261-4619-9fd5-5d1a78439d8a admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:19.221178 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d9857ed9-3261-4619-9fd5-5d1a78439d8a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020114 Aug 12 10:44:19.221705 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 23/46] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:19.233647 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-acaae2df-bc48-4b05-9767-c7df01a7d962 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:19.241716 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.wsgi [None req-acaae2df-bc48-4b05-9767-c7df01a7d962 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-acaae2df-bc48-4b05-9767-c7df01a7d962 admin admin] Request method failure captured: Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept: application/json Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept-Encoding: gzip, deflate Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Connection: keep-alive Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Content-Length: 0 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Host: 10.222.0.23 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-System-Scope: None Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: User-Agent: python-novaclient Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Auth-Token: gAAAAABi9i8CNnX80t4ru_r0iIkHydSKQKGtiDbTgUCHqYHLX49IXPFppRmlMVPAQsDiavnu7vwfZS0fyrtyYzzOFjAba5azjevAC91qxa9PjoB7RDiyOxD9Pnd8F_OOIv23E8WbN0dA-JAbrP9vfqCiFviyBwDVyWyOL2Z2PZJg5HNB0ttxKWM Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Id: None Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Name: None Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Identity-Status: Confirmed Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Is-Admin-Project: True Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Id: default Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Name: Default Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Name: admin Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Role: reader,admin,member Aug 12 10:44:19.243816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Roles: reader,admin,member Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant: admin Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Name: admin Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User: admin Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Id: default Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Name: Default Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Name: admin Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: method: > Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: exception: Flavor 84 could not be found. Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: action_args: {'id': '84'} Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:19.245310 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:19.246225 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:19.247691 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-acaae2df-bc48-4b05-9767-c7df01a7d962 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:19.248931 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-acaae2df-bc48-4b05-9767-c7df01a7d962 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017326 Aug 12 10:44:19.248931 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 24/47] 10.222.0.23 () {60 vars in 1190 bytes} [Fri Aug 12 10:44:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 10:44:20.229561 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d9857ed9-3261-4619-9fd5-5d1a78439d8a admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:20.230590 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d9857ed9-3261-4619-9fd5-5d1a78439d8a admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 12 10:44:20.230988 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 24/48] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:20.805256 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-6f8f544e-a3fc-498c-a454-19367c697e69 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:20.811070 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.wsgi [None req-6f8f544e-a3fc-498c-a454-19367c697e69 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-6f8f544e-a3fc-498c-a454-19367c697e69 admin admin] Request method failure captured: Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept: application/json Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Accept-Encoding: gzip, deflate Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Connection: keep-alive Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Content-Length: 0 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Host: 10.222.0.23 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Openstack-System-Scope: None Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: User-Agent: python-novaclient Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Auth-Token: gAAAAABi9i8Eo9rlzFNF8F9GbR-0RCKhN4WJUWxRwGMg5KznFf-lBZxOHIfwp_AVuAX04SB2poESOYLGCDSUAcD7-CP-TmYMFghRALBLGl-4eJzHh4xHonKgW06LiUE0BRyK27q3OmZcYSrt4u_7Iq3EzFlxv4VtJj_U5j1xM9O9jQu4JTup2bU Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Id: None Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Domain-Name: None Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Identity-Status: Confirmed Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Is-Admin-Project: True Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Id: default Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Domain-Name: Default Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Project-Name: admin Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Role: reader,admin,member Aug 12 10:44:20.812617 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Roles: reader,admin,member Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant: admin Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-Tenant-Name: admin Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User: admin Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Id: default Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Domain-Name: Default Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: X-User-Name: admin Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: method: > Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: exception: Flavor 451 could not be found. Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: action_args: {'id': '451'} Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:20.814250 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:20.815169 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.816556 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-6f8f544e-a3fc-498c-a454-19367c697e69 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:20.817891 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-6f8f544e-a3fc-498c-a454-19367c697e69 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.446798 Aug 12 10:44:20.817891 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 25/49] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:44:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 448 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 10:44:20.828206 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-069abbfe-9948-48c0-9554-a43aa6fefc91 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:20.846214 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-069abbfe-9948-48c0-9554-a43aa6fefc91 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023808 Aug 12 10:44:20.846751 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 25/50] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:20.859679 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:20.877496 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023803 Aug 12 10:44:20.878027 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 26/51] 10.222.0.23 () {60 vars in 1210 bytes} [Fri Aug 12 10:44:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:44:20.888565 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d85a8808-a91b-4782-bffe-0edc7221d208 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:20.894137 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.wsgi [None req-d85a8808-a91b-4782-bffe-0edc7221d208 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d85a8808-a91b-4782-bffe-0edc7221d208 admin admin] Request method failure captured: Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept: application/json Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Accept-Encoding: gzip, deflate Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Connection: keep-alive Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Content-Length: 0 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Host: 10.222.0.23 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-Api-Version: compute 2.90 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Openstack-System-Scope: None Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: User-Agent: python-novaclient Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Auth-Token: gAAAAABi9i8Eo9rlzFNF8F9GbR-0RCKhN4WJUWxRwGMg5KznFf-lBZxOHIfwp_AVuAX04SB2poESOYLGCDSUAcD7-CP-TmYMFghRALBLGl-4eJzHh4xHonKgW06LiUE0BRyK27q3OmZcYSrt4u_7Iq3EzFlxv4VtJj_U5j1xM9O9jQu4JTup2bU Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Id: None Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Domain-Name: None Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Identity-Status: Confirmed Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Is-Admin-Project: True Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Openstack-Nova-Api-Version: 2.90 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Id: default Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Domain-Name: Default Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Project-Name: admin Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Role: reader,admin,member Aug 12 10:44:20.895636 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Roles: reader,admin,member Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1b6e50f80fbe471b845ef361f068a613"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1b6e50f80fbe471b845ef361f068a613"}]}] Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant: admin Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Id: 1b6e50f80fbe471b845ef361f068a613 Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-Tenant-Name: admin Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User: admin Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Id: default Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Domain-Name: Default Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Id: 28302e0508fb4cc195a19e42f7da3046 Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: X-User-Name: admin Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: method: > Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: exception: Flavor 451 could not be found. Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: action_args: {'id': '451'} Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:44:20.897241 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:20.898164 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: ERROR nova.api.openstack.wsgi Aug 12 10:44:20.899416 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-d85a8808-a91b-4782-bffe-0edc7221d208 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117156) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:44:20.900641 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-d85a8808-a91b-4782-bffe-0edc7221d208 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013105 Aug 12 10:44:20.900641 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 26/52] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:44:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 12 10:44:21.878764 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:21.879816 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 12 10:44:21.880210 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 27/53] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:22.467698 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-31949521-22b6-46db-a474-59f3d532d494 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:44:22.489372 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-31949521-22b6-46db-a474-59f3d532d494 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.465595 Aug 12 10:44:22.490011 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 27/54] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Aug 12 10:44:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:44:23.499629 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:23.500689 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 12 10:44:23.501126 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 28/55] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:24.050708 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-1d88bf68-7f5c-43c4-909e-999b4ec15880 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:44:24.077600 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-1d88bf68-7f5c-43c4-909e-999b4ec15880 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.437879 Aug 12 10:44:24.078494 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 28/56] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Aug 12 10:44:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:44:25.053907 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:25.054926 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 12 10:44:25.055436 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 29/57] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:25.659694 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-a815e93d-82f4-4655-ad84-98ac51eb4866 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:44:25.684286 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-a815e93d-82f4-4655-ad84-98ac51eb4866 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.485667 Aug 12 10:44:25.684862 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 29/58] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Aug 12 10:44:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:44:26.651585 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:26.652658 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 12 10:44:26.653041 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 30/59] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:27.183906 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-3b8c9e28-c321-40f3-a493-8e0dd76dbaee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:44:27.205567 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-3b8c9e28-c321-40f3-a493-8e0dd76dbaee admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.417142 Aug 12 10:44:27.206056 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1235 bytes} [Fri Aug 12 10:44:26 2022] POST /compute/v2.1/flavors => generated 409 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:44:28.197301 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:28.198315 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 12 10:44:28.198712 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 31/61] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:44:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:44:28.765432 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-c86fcf96-cd75-4b7a-8e37-ba1ea1a10fcf admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:44:28.787234 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-c86fcf96-cd75-4b7a-8e37-ba1ea1a10fcf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450933 Aug 12 10:44:28.787788 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 31/62] 10.222.0.23 () {60 vars in 1202 bytes} [Fri Aug 12 10:44:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:45:23.089842 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.091088 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-139c696e-e787-409a-9c11-0f1ad9bfa7c7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Aug 12 10:45:23.091587 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 32/63] 10.222.0.23 () {54 vars in 931 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:45:23.105985 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:23.533124 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-682441b8-6ddb-4a6e-9d9c-440c1d0a5c1e admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.557345 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-682441b8-6ddb-4a6e-9d9c-440c1d0a5c1e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.456465 Aug 12 10:45:23.557904 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 32/64] 10.222.0.23 () {60 vars in 1292 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:45:23.583393 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG dbcounter [-] [117155] Writing DB stats nova_api:SELECT=14 {{(pid=117155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:45:23.587223 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-22c1442f-784f-4ea9-b4ed-a8b5a23bf70a admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.595466 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-22c1442f-784f-4ea9-b4ed-a8b5a23bf70a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013576 Aug 12 10:45:23.595996 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 33/65] 10.222.0.23 () {60 vars in 1283 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:45:23.608487 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-e8bc2054-75c8-4404-afcc-5e209af5f89a admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.617463 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-e8bc2054-75c8-4404-afcc-5e209af5f89a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012425 Aug 12 10:45:23.618386 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 33/66] 10.222.0.23 () {60 vars in 1286 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:45:23.632292 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.641589 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012931 Aug 12 10:45:23.642155 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 34/67] 10.222.0.23 () {60 vars in 1286 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:45:23.656610 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-21a57747-6bd9-473c-b12a-69db5d67a743 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:45:23.664688 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-21a57747-6bd9-473c-b12a-69db5d67a743 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011683 Aug 12 10:45:23.665297 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 34/68] 10.222.0.23 () {60 vars in 1283 bytes} [Fri Aug 12 10:45:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:48:19.185243 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:19.186270 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 12 10:48:19.186659 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 35/69] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:48:19.339078 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_api:SELECT=6 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:19.519128 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:19.521502 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:48:19.521502 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:48:19.522639 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:19.523182 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:19.523604 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:19.524343 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:19.524789 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:19.525204 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:19.563430 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-67e9ee47-d6a5-424c-8a01-ee17aa433847 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.225700 Aug 12 10:48:19.564004 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 35/70] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:48:19 2022] GET /compute/v2.1/os-services => generated 791 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:48:20.466921 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:20.467993 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 12 10:48:20.468415 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 36/71] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:48:20.699470 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:20.702098 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:48:20.702098 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:48:20.703539 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:20.704016 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:20.704477 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:20.705182 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:20.705750 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:20.706163 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:20.725728 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-c77cbaac-ce09-4d0b-808f-b326d9ebcb6a admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.090607 Aug 12 10:48:20.726342 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 36/72] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:48:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:48:31.973381 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:31.974398 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 12 10:48:31.974805 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 37/73] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:48:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:48:32.124809 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_cell0:SELECT=4 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:32.125911 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_cell1:SELECT=4 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:32.126983 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG dbcounter [-] [117156] Writing DB stats nova_api:SELECT=8 {{(pid=117156) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:48:32.194017 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:32.196422 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:48:32.196422 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:48:32.197526 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:32.198003 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:32.198431 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:32.199182 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:32.199628 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:32.200045 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:32.224613 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-471eb6a0-5e2f-4622-b30b-f29e2faf6088 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.107723 Aug 12 10:48:32.225196 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 37/74] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:48:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:48:33.064390 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: DEBUG nova.api.openstack.wsgi [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] Calling method '>' {{(pid=117155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:33.065436 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: INFO nova.api.openstack.requestlog [None req-957859c9-be82-4ad3-80f6-e87e651d10aa admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 12 10:48:33.065839 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: [pid: 117155|app: 0|req: 38/75] 10.222.0.23 () {56 vars in 1074 bytes} [Fri Aug 12 10:48:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:48:33.269192 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG nova.api.openstack.wsgi [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Calling method '>' {{(pid=117156) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:48:33.271661 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 12 10:48:33.271661 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: warnings.warn(msg) Aug 12 10:48:33.272978 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:33.273308 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:33.273728 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:33.274433 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:48:33.274965 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:48:33.275370 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: DEBUG oslo_concurrency.lockutils [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117156) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:48:33.296784 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: INFO nova.api.openstack.requestlog [None req-39740735-8a46-429e-93d9-fb95587154b7 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093394 Aug 12 10:48:33.297368 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: [pid: 117156|app: 0|req: 38/76] 10.222.0.23 () {60 vars in 1193 bytes} [Fri Aug 12 10:48:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:49:29.550199 dv-cinder-852945-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 12 10:49:29.551118 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: Fri Aug 12 10:49:29 2022 - graceful shutdown triggered... Aug 12 10:49:29.551600 dv-cinder-852945-1-iscsi devstack@n-api.service[117156]: Gracefully killing worker 2 (pid: 117156)... Aug 12 10:49:29.551965 dv-cinder-852945-1-iscsi devstack@n-api.service[117155]: Gracefully killing worker 1 (pid: 117155)... Aug 12 10:49:30.552398 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: worker 1 buried after 1 seconds Aug 12 10:49:30.552398 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: worker 2 buried after 1 seconds Aug 12 10:49:30.552398 dv-cinder-852945-1-iscsi devstack@n-api.service[117154]: goodbye to uWSGI. Aug 12 10:49:30.554003 dv-cinder-852945-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 12 10:49:30.554682 dv-cinder-852945-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 12 10:49:30.557809 dv-cinder-852945-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 12 10:49:30.567536 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 12 10:49:30 2022] *** Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: nodename: dv-cinder-852945-1-iscsi Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: machine: x86_64 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: clock source: unix Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: pcre jit disabled Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: detected number of CPU cores: 4 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: current working directory: / Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: detected binary path: /usr/bin/uwsgi-core Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: your processes number limit is 47680 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: your memory page size is 4096 bytes Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: detected max file descriptor number: 2048 Aug 12 10:49:30.569559 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: lock engine: pthread robust mutexes Aug 12 10:49:30.570468 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: thunder lock: enabled Aug 12 10:49:30.570468 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 12 10:49:30.570468 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 12 10:49:30.611556 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: Python main interpreter initialized at 0x558e093e19c0 Aug 12 10:49:30.611556 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: python threads support enabled Aug 12 10:49:30.611556 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: your server socket listen backlog is limited to 100 connections Aug 12 10:49:30.611556 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: your mercy for graceful operations on workers is 90 seconds Aug 12 10:49:30.612485 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: mapped 403077 bytes (393 KB) for 2 cores Aug 12 10:49:30.612485 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: *** Operational MODE: preforking *** Aug 12 10:49:30.612485 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: *** uWSGI is running in multiple interpreter mode *** Aug 12 10:49:30.612485 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: spawned uWSGI master process (pid: 132220) Aug 12 10:49:30.612346 dv-cinder-852945-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 12 10:49:30.612967 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: spawned uWSGI worker 1 (pid: 132239, cores: 1) Aug 12 10:49:30.613248 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: spawned uWSGI worker 2 (pid: 132240, cores: 1) Aug 12 10:49:30.615174 dv-cinder-852945-1-iscsi devstack@n-api.service[132220]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 12 10:49:31.269153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 10:49:31.287211 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 12 10:49:32.410080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:49:32.410080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: from cryptography.utils import int_from_bytes Aug 12 10:49:32.410717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:49:32.410717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: from cryptography.utils import int_from_bytes Aug 12 10:49:32.462670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:49:32.462670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: from cryptography.utils import int_from_bytes Aug 12 10:49:32.463313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 12 10:49:32.463313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: from cryptography.utils import int_from_bytes Aug 12 10:49:34.691132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:49:34.691663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:49:34.691920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:49:34.692331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:49:34.692598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:49:34.692996 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.693325 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.693695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.693978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.694311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.694661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.694968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.695293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.695626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.695892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.696298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.696578 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852945-1-iscsi {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.696904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.697225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.697547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.697854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.698166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.698546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.698806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.699308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.700855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.700855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.700855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.700855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.701217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.701383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.701671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.701987 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.702316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.702633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.703047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852945-1-iscsi {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.703371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.703690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.704010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.704471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.704848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.705720 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.706081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.706397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.706714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.707049 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.707376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.707705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.708031 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.708364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.708683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.708997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.709326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.709644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.709969 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.710214 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.710533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.710860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.711186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.711517 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.711769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.712020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.712368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.712679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.712991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.713317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.713612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.713926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.714230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.714539 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.714848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.715166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.715486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.715804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.716129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.716468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.716793 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.717196 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.717449 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.717765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.718115 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.718435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.718753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.719075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.719397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.719712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.720019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.720355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.720711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.721059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.721370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.721626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.721932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.722243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.722570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.722878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.723365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.723834 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.724149 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.724497 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.724817 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.725135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.725451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.725761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.726088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.726381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.726697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.727003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.727329 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.727658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.727974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.728300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.728618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.728931 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.729258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.729568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.729876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.730370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.730717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.731026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.731354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.731665 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.732059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.732295 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.732660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.732952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.733278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.733611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.733874 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.734212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.734521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.734811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.735140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.735432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.735740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.736050 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.736451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.737155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.737155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.737488 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.737799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.738127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.738472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.738814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.739164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.739473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.739814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.740155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.740507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.740854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.741152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.741486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.741806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.742369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.742488 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.742750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.743081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.743410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.743732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.744054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.744412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.744734 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.745059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.745396 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.745727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.746048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.746395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.746751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.747072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.747421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.747737 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.748056 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.748417 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.748738 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.749062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.749403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.749721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.750045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.750364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.750680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.750991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.751305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.751621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.752011 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.752565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.752678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.752995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.753343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.753633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.753949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.754263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.754575 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.754889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.755198 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.755512 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.755826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.756154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.756517 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.756837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.757203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.757491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.757805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.758118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.758432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.758743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.759059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.759376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.759685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.760017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.760354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.760666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.760993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.762819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.763135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.763463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.763784 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.764094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.764458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.764797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.765109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.765443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.765768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.766266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.766577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.767228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.767696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.768200 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.768447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.768769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.769085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.769398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.769710 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.770063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.770327 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.770659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.770973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.771288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.771597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.771904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.772252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.772585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.772934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.773278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.773604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.773934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.774252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.774573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.774893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.775209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.775522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.775838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.776162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.776504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.776830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.777345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.777499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.777791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.778114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.778425 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.778744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.779088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.779445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.779746 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.780071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.780493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.780813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.781131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.781446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.781761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.782074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.782399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.782711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.783079 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.783945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.783945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.784162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.784516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.784839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.785152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.785489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.785842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.786142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.786451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.786777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.787094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.787411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.787724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.788033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.788368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.788685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.789009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.789320 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.789638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.789946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.790266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.790581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.790893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.791205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.791533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.791832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.792147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.792605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.792835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.793127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.793439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.793766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.794399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.794399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.794687 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.794997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.795346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.795662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.795972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.796373 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.796634 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.796947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.797269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.797581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.797896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.798224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.798599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.798946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.799264 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.799720 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.799888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.800190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.800564 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.800865 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.801178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.801491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.801800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.802189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.802436 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.803030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.803466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.803683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.804020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.804410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.804687 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.805032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.805380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.805701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.806010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.806340 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.806628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.806944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.807255 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.807561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.808305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.808305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.808504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.809139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.809139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.809622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.809730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.810018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.810314 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.810631 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.810937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.811266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.811577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.811885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.812189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.812523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.812870 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.813179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.813528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.813864 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.814274 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.814588 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.814905 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.815234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.815544 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.815859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.816160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.816499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.816813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.817119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.817432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.817747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.818256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.818389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.818656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.818968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.819280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.819596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.819908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.820220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.820554 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.820950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.821183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.821494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.821806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.822112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.822430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.822740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.823119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.823423 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.823743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.824051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.824379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.824717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.825042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.825344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.825654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.825966 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.826277 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.826582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.826898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.827223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.827546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.827855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.828378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.828505 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.828801 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.829109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.829450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.829728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.830034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.830342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.830670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.831118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.831644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.831757 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.832085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.832435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.832704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.833052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.833365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.833873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.834042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.834361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.834693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.835276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.835390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.835627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.835935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.836686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.836686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.837125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.837343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.838009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.838009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.838513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.838628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.838927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.839243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.839574 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.839883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.840197 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.841283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.841283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.841283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.841283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.841955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.842174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.842493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.842809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.843121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.843432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.843745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.844066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.844387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.844724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.845038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.845348 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.845830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.846378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.846486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.846911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.847601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.848099 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.848938 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.849152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.849463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.849767 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.850373 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.850719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.851203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.851914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.852455 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.852885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.853229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.853536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.853855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.854179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.854520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.854846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.855156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.855473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.855808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.856125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.856480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.856910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.857231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.857545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.857973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.858294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.858672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.858961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.859267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.859602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.859914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.860236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.860576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.860908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.861307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.861609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.861961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.862382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.862563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.862894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.863217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.863547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.863969 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.864422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.864652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.864988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.865318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.866052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.866773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.867097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.867549 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 12 10:49:34.868004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.868083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 12 10:49:34.868155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.868155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.868323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 12 10:49:34.868409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.868540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 12 10:49:34.868697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.868787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 12 10:49:34.869023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.869175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.869362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.869774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.870096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.870418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.870733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.871059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.871380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.871711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.872038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.872408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.872570 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.872714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.872827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.873031 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.873161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.873343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.873596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.873704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.874010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.874127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.874301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.874406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.874647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.874738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.874982 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.875080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.875251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.875348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.875610 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.875739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.875942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.876049 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852945-1-iscsi {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.876227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.876410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.876627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.876728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.877060 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.877205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.877337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.877699 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.877898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.878162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.878343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.878552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.878658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.878844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.878944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.879138 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.879397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.879540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.879751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.880079 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.880190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.880464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.880565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.880748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.880937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.881018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.881229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.881335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.881527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.881629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.881826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.881976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.882249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.882389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.882617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.882725 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.882915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.883008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.883179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.883281 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.883540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.883704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852945-1-iscsi {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.884012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.884125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.884208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.884307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.884604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.884718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.885033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.885133 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.885400 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.885493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.885791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.885936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.886141 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.886295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.886545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.886696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.886878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.887044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.887307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.887495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.887646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.887791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.887951 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.887951 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.888238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.889118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.889280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.889444 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.889595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.889755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.889911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.890075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.890393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.890563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.890563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.890860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.891013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.891160 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.891304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.891304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.891600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.891761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.892251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.892251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.892732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.892732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.893018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.893164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.893164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.893441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.893599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.893753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.893907 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.894172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.894364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.894527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.894684 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.894831 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.895146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.895308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.895457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.895612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.895770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.895922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.896081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.896227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.896416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.896574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.896728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.896881 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.897035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.897194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.897466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.897620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.897774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.897921 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.898073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.898240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.898414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.898657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.898810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.898810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.899099 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.899254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.899410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.899557 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.899702 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.899847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.899992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.900160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.900160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.900579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.900835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.900997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.901152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.901310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.901465 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.901465 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.901762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.901762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.902058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.902219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.902389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.902621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.902780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.902780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.903084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.903280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.903431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.903541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.903683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.903795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.903949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.904174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.904443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.904644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.904862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.905015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.905356 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.905521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.905668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.905847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.906004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.906004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.906296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.906537 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.906703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.906863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.907010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.907171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.907318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.907490 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.907737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.907920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.908072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.908339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.908495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.908646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.908886 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.909097 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.909281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.909452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.909613 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.909837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.910089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.910265 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.910463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.910732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.910998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.911154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.911301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.911448 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.911647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.911823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.911973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.912151 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.912337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.912499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.912696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.912849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.912995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.913141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.913286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.913286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.913575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.913770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.913931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.914078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.914268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.914445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.914696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.914857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.915011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.915166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.915466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.915626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.915626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.915946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.916113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.916391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.916548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.916701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.916855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.917002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.917157 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.917311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.917460 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.917460 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.917763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.918039 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.918202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.918402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.918553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.918707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.918707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.918999 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.919154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.919301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.919461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.919615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.919761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.919915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.920103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.920253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.920453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.920601 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.920830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.920830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.921232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.921385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.921545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.921695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.921850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.922005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.922192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.922343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.922528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.922697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.922846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.923009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.923157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.923311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.923466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.923649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.923802 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.924025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.924181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.924368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.924368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.924665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.924920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.925073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.925218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 12 10:49:34.925366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.925679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.925832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.925992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.926973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927592 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.927903 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928497 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.928972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929419 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.929877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930700 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.930872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.931116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.931551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.931708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.931870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932645 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932801 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.932956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.933866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.934150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.934304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.934494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.934645 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.934801 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.935976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936668 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936817 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.936963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937437 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937585 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.937732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.938009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.938160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.938332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.938603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.939189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.939403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.939558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.939704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.939871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.940902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.941057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.941308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.941308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.941712 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.941883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.942803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943535 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.943987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.944133 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.944309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.944462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.944621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.945446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.945617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.945935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946400 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.946919 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947237 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.947993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948152 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.948977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.949285 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.949442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.949604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.949604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.949890 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.950785 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.951072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.951232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.951502 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.951694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.951853 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.952009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.952320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.952496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.952776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.952929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.953075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.953305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.953762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.953918 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.954259 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.954420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.954598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.954992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.955335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.955335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.955627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.955774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.956150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.956403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.956578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.956727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.957034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.957217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.957374 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.957660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.957902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.958155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.958379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.958548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.958704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.958872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959469 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959638 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959794 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.959941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.960903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.961151 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.961310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.961489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.961730 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.961894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.962051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.962206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.962422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.962596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.962903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.963092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.963251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132239) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:49:34.963407 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.963553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.963778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.964098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.964438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.964780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.965177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.965493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.965800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.966268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.966687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.967000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.967335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.967648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.968096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.968434 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.968802 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.969304 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.969762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.969935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.970240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.970689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.971870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.972388 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.972719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.973081 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.973374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.973697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.974132 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.974476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.974839 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.975242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.975633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.975906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.976452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.976694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.977037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.977421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.977836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.978156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.978481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.978871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.979232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.979584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.979901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.980214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.980659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.980986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.981343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.981776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.982150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.982488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.982828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.983280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.983564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.983908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.984242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.984599 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.984998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.985315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.985826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.986310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.987395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.987717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.988037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.988547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.988888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.989205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.989544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.990052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.990285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.990637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.990923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.991268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.991785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.992013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.992382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.992799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.993111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.993471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.993774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.994092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.994403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.994716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.995126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:34.998928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.000897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.002648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.002648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.002648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.003115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.003318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.003478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.003786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.004416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.004758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.005078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.005401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.005725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.006050 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.006388 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.006721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.007067 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.007379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.007693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.008002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.008550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.008716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.010464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.010682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.011003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.011329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.011722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.012046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.012391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.012712 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.013030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.013343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.013663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.013972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.014312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.014623 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.014933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.015242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.015549 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.015899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.016207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.016584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.017236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.018667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.018862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.019126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.019427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.019738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.020053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.020480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.020803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.021029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.021345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.021674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.021986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.022302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.022616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.022920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.023228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.023534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.023853 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.024164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.024502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.024804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.025117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.025428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.025737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.026223 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.026649 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.027070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.027379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.027685 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.027992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.028354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.028867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.029040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.029293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.029608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.029914 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.030219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.030620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.030933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.031780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.031780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.031780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.032276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.032542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.032813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.033157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.034043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.034375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.034697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.035008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.035324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.035635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.035945 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.036253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.036613 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.036932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.037240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.037617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.037928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.038281 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.038591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.039101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.039280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.039568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.039891 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.040206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.040565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.040880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.041246 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.041559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.041876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.042188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.042495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.042796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.043221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.043428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.043738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.044060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.044413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.044882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.045043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.045347 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.045659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.045967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.046279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.046588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.046905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.047216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.047529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.047840 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.048150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.048502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.049450 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.049838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.050161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.050496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.050914 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.051129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.051486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.051732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.052042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.052381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.052847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.053348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.053544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.053852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.054163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.054474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.054792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.055113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.055417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.055837 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.056270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.056526 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.056864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.057179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.057485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.057796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.058124 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.058431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.058745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.059041 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.059592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.059763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.059994 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.060438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.060754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.061061 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.062161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.062161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.062161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.062596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.062742 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.063010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.063314 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.063885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.064329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.065382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.065722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.066044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.066366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.066683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.067015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.067344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.067673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.068002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.068453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.068784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.069100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.069692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.069864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.070057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.070371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.070682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.070991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.071305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.071630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.071939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.072254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.072586 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.072897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.073208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.073512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.074380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.074380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.074702 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.074861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.075057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.075388 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.075692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.076015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.076352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.076651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.077234 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.077568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.077924 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.078230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.078554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.079047 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.079509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.082002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.082459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.082810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.083149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.083487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.083827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.084146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.084489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.084815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.085130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.085446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.085797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.086112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.086426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.086743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.087058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.088799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.089356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.090059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.090563 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.090901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.091568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.091940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.092292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.092657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.093380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.093380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.093717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.094081 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.094261 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.094586 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.095024 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.095251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.095576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.095901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.096423 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.096720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.097217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.097996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.098348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.098674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.099094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.099565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.099854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.100429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.100857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.101164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.101661 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.101990 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.102988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.102988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.103293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.103449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.103819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.104033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.104495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.104690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.105020 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.105342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.105655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.105977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.107627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.107627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.107627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.107627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.107627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.108478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.108478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.108478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.108941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.109094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.109723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.109723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.110085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.110497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.110760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.111485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.112155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.113317 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.113317 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.113720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.114202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.114711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.115192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.115562 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO dbcounter [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Registered counter for database nova_api Aug 12 10:49:35.115745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.116178 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.116689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.117195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.117673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.118156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.118663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.119156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.119648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.120247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.120829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.121825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.122491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.123052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.123634 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.124218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.124856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.125250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.125567 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.125885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.126202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.126527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.126926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.127288 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.127582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.127902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.128215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.128551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.128866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.129342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.129888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.130279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.130788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.131351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.131807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.132093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.132546 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.132809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.133107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.133427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.133738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.134053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.134364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.134693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.135005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.135318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.135629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.135967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.136293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.136667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_db.sqlalchemy.engines [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.136797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.136967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.137282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.137607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.137927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.138240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.139011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.139011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.139486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.139809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.140136 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.140507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.140920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.141154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.141464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.141774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.142741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.143064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.143379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.143692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.144005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.144164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writer thread running {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.144345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.144643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.144960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.145270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.145580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.145889 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.146200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.146509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.146818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.147126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.147441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.147785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.148106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.148449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.148767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.149085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.149397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.149922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.150412 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.150925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.151346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.151908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.152368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.152826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.153502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.153830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.154159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.154489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.154808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.155140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.155469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.155785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.156112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.156498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.156839 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.157187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.157521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.157856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.158247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.158561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.158871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.159186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.159509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.159824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.160134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.160464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.160775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.161082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.161387 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.161694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.162000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.162316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.162622 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.162928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.163235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.163540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.163846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.164161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.164486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.164793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.165173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.165404 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.165713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.166017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.166350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.166685 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.167002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.167327 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.167636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.167960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.168289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.168617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.168941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.169263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.169573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.169906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.170219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.170530 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.170841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.171157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.171467 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.171776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.172107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.172460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.172770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.173097 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.173416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.173856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.174123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.174436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.174769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.175080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.175393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.175701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.176005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.176335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.176652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.176964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.177276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.177592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.177907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.178235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.178561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.178872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.179200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.179527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.179874 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.180187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.180558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.180886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.181222 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.181515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.181822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 12 10:49:35.182067 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 12 10:49:35.201962 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.context [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbfddc02-5078-4af6-bce3-a7173079e6ee(cell1) {{(pid=132239) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 10:49:35.206795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:49:35.207289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:49:35.208989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:49:35.209824 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:49:35.210290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:49:35.212420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:49:35.214570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO dbcounter [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Registered counter for database nova_cell0 Aug 12 10:49:35.219184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO dbcounter [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Registered counter for database nova_cell1 Aug 12 10:49:35.229590 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_db.sqlalchemy.engines [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.230471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_db.sqlalchemy.engines [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.238345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writer thread running {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.239688 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writer thread running {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.332480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO dbcounter [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Registered counter for database nova_api Aug 12 10:49:35.353309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_db.sqlalchemy.engines [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.361584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writer thread running {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.385448 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO dbcounter [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Registered counter for database nova_cell0 Aug 12 10:49:35.393027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_db.sqlalchemy.engines [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132239) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.397528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writer thread running {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.424977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.context [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbfddc02-5078-4af6-bce3-a7173079e6ee(cell1) {{(pid=132240) load_cells /opt/stack/nova/nova/context.py:464}} Aug 12 10:49:35.429458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:49:35.429900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:49:35.431723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:49:35.432528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:49:35.433046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:49:35.435296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:49:35.437567 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO dbcounter [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Registered counter for database nova_cell0 Aug 12 10:49:35.442482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO dbcounter [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Registered counter for database nova_cell1 Aug 12 10:49:35.451232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_db.sqlalchemy.engines [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.454866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_db.sqlalchemy.engines [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.456718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writer thread running {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.611718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writer thread running {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.623545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO dbcounter [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Registered counter for database nova_cell0 Aug 12 10:49:35.633142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_db.sqlalchemy.engines [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 12 10:49:35.638488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writer thread running {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 12 10:49:35.717179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: WARNING keystonemiddleware.auth_token [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:49:35.725094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: WARNING keystonemiddleware.auth_token [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:49:35.980385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: WARNING keystonemiddleware.auth_token [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:49:35.988071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: WARNING keystonemiddleware.auth_token [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:49:36.067131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: WARNING keystonemiddleware.auth_token [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:49:36.073233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: WARNING keystonemiddleware.auth_token [None req-48828079-eab9-464f-9b63-481f5a58a1f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:49:36.079538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e093e19c0 pid: 132239 (default app) Aug 12 10:49:36.329022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: WARNING keystonemiddleware.auth_token [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 12 10:49:36.335450 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: WARNING keystonemiddleware.auth_token [None req-3096a9a6-8347-4003-a49d-a57fdb878601 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 12 10:49:36.341824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e093e19c0 pid: 132240 (default app) Aug 12 10:50:11.312368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.314005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.314772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.315899 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.416929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.417913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.419025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:11.419960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:12.483666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7464f22e-22fe-4d8d-a127-65d202872878 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Action: 'create', calling method: .version_select at 0x7efc5e973d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1837006310", "metadata": {"Type": "work"}}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:12.879960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f7f6eaa4-b1ac-476f-a4d3-dc7114e11de3 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Action: 'create', calling method: .version_select at 0x7efc5e963d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459193737", "metadata": {"Type": "work"}}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f7f6eaa4-b1ac-476f-a4d3-dc7114e11de3 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 122 Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:50:12.898564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1459193737", "metadata": {"Type": "work"}}} Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:50:12.900022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1459193737', 'metadata': {'Type': 'work'}}}} Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise error Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi '#$%' Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:12.900908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 10:50:12.903779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 10:50:12.906829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 12 10:50:12.906829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.906829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f7f6eaa4-b1ac-476f-a4d3-dc7114e11de3 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:12.906829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f7f6eaa4-b1ac-476f-a4d3-dc7114e11de3 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.490234 Aug 12 10:50:12.912370 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Aug 12 10:50:11 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1502 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 10:50:12.922189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91216867-cf87-4936-b273-1eeed3ffc1da tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Action: 'create', calling method: .version_select at 0x7efc5e874820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-587751441", "metadata": {"Type": "work"}}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91216867-cf87-4936-b273-1eeed3ffc1da tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 119 Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:50:12.935163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-587751441", "metadata": {"Type": "work"}}} Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:50:12.936441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-587751441', 'metadata': {'Type': 'work'}}}} Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise error Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi '0' Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:12.937200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 10:50:12.938444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 10:50:12.942879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 12 10:50:12.942879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.942879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91216867-cf87-4936-b273-1eeed3ffc1da tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:12.942879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-91216867-cf87-4936-b273-1eeed3ffc1da tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022718 Aug 12 10:50:12.942879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Aug 12 10:50:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:50:12.960637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-02dfed7f-fb79-480b-bb6d-bc1974f0ddbf tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Action: 'create', calling method: .version_select at 0x7efc5e82c8b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-436908500", "metadata": {"Type": "work"}}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-02dfed7f-fb79-480b-bb6d-bc1974f0ddbf tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 118 Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:50:12.965452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-436908500", "metadata": {"Type": "work"}}} Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:50:12.966717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-436908500', 'metadata': {'Type': 'work'}}}} Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise error Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi '' Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:12.967480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 12 10:50:12.968800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 12 10:50:12.969991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 12 10:50:12.969991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:12.969991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-02dfed7f-fb79-480b-bb6d-bc1974f0ddbf tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:12.973892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-02dfed7f-fb79-480b-bb6d-bc1974f0ddbf tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020349 Aug 12 10:50:12.976051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 3/3] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Aug 12 10:50:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:50:12.991266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f459b728-d5d2-4938-8dd6-d1b60f8d83b5 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Calling method '.version_select at 0x7efc5e82c5e0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:13.854444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-f459b728-d5d2-4938-8dd6-d1b60f8d83b5 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] HTTP exception thrown: Volume tempest-invalid-1108443161 could not be found. Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f459b728-d5d2-4938-8dd6-d1b60f8d83b5 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1108443161 HTTP/1.1 Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:50:13.869897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Volume tempest-invalid-1108443161 could not be found. Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'tempest-invalid-1108443161'} Aug 12 10:50:13.871844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1108443161 could not be found. (HTTP 404) (Request-ID: req-024957a6-26bc-4fd0-be76-55ee18609e38) Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:13.872804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:50:13.874465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1108443161 could not be found. Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:50:13.875993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1108443161 could not be found. Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1108443161 could not be found. Aug 12 10:50:13.877537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:13.881580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f459b728-d5d2-4938-8dd6-d1b60f8d83b5 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 404 to user: Volume tempest-invalid-1108443161 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:13.898468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f459b728-d5d2-4938-8dd6-d1b60f8d83b5 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1108443161" status: 404 len: 99 microversion: 2.1 time: 0.902016 Aug 12 10:50:13.899180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 4/4] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Aug 12 10:50:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1108443161 => generated 99 bytes in 919 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 12 10:50:13.917306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cd841701-624b-4179-96bf-b55a5d2e3ea8 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011765 Aug 12 10:50:13.922505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 5/5] 10.222.0.23 () {58 vars in 1140 bytes} [Fri Aug 12 10:50:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 10:50:13.941096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7464f22e-22fe-4d8d-a127-65d202872878 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.638864 Aug 12 10:50:13.945144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8b351b79-c947-4310-99f7-97416eb05326 tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.014010 Aug 12 10:50:13.949402 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 6/6] 10.222.0.23 () {58 vars in 1137 bytes} [Fri Aug 12 10:50:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 12 10:50:13.955881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 1/7] 10.222.0.23 () {60 vars in 1156 bytes} [Fri Aug 12 10:50:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2655 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 10:50:13.964161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c22bb59c-b44f-419b-ad6f-e9108735e84d tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Calling method '.version_select at 0x7efc5e7cbb80>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:13.965284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c27693be-5bb2-48ec-8a71-c31425c9c2a0 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e760b80>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:14.006627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-c22bb59c-b44f-419b-ad6f-e9108735e84d tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] HTTP exception thrown: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c22bb59c-b44f-419b-ad6f-e9108735e84d tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: DELETE /compute/v2.1/os-volumes/52d0864d-50b2-42cc-8f91-bf47549ed568 HTTP/1.1 Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:50:14.011802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '52d0864d-50b2-42cc-8f91-bf47549ed568'} Aug 12 10:50:14.014342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. (HTTP 404) (Request-ID: req-c554da5e-fc51-4a75-ad16-9cd86211b818) Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.015472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:50:14.016896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 10:50:14.018747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c22bb59c-b44f-419b-ad6f-e9108735e84d tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 404 to user: Volume 52d0864d-50b2-42cc-8f91-bf47549ed568 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:14.019942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c22bb59c-b44f-419b-ad6f-e9108735e84d tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/52d0864d-50b2-42cc-8f91-bf47549ed568" status: 404 len: 109 microversion: 2.1 time: 0.054828 Aug 12 10:50:14.027071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 2/8] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:50:13 2022] DELETE /compute/v2.1/os-volumes/52d0864d-50b2-42cc-8f91-bf47549ed568 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:50:14.045863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-848637c8-63cc-4286-a42f-6679e98c016a tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Calling method '.version_select at 0x7efc5f156160>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:14.081868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c27693be-5bb2-48ec-8a71-c31425c9c2a0 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 200 len: 353 microversion: 2.1 time: 0.129122 Aug 12 10:50:14.082969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 7/9] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:13 2022] GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:14.141148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-848637c8-63cc-4286-a42f-6679e98c016a tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] HTTP exception thrown: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-848637c8-63cc-4286-a42f-6679e98c016a tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Request method failure captured: Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/os-volumes/ad9ed314-dc9f-42c6-91cf-476b2a383cd4 HTTP/1.1 Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBjh8kuA8utAUdmD7K_DC2UcFDNLcZHBRGgEjmbGLW49yVh57geYldfE-opHiUS0QzNeoAL5ZvE2m4HgJVcEx8bXnzUJeAi6hkzL9u66iVEXkwL7rac8Wv5MIBdSUfE_zYyS0hapsNsaGyw1RO44N_rdkh0gAGVm1GsyefWFY51Hzw Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:50:14.144216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e778a4db38cd407092cb639b9738e35a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e778a4db38cd407092cb639b9738e35a"}]}] Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: e778a4db38cd407092cb639b9738e35a Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-VolumesNegativeTest-1003267915 Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: d49986e88ae049bc8146010dd3a79af2 Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-VolumesNegativeTest-1003267915-project Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'ad9ed314-dc9f-42c6-91cf-476b2a383cd4'} Aug 12 10:50:14.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. (HTTP 404) (Request-ID: req-c593d448-4f83-4b15-a5ba-56dda38f0591) Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.146715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:50:14.148087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 10:50:14.149446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:50:14.150791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-848637c8-63cc-4286-a42f-6679e98c016a tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] Returning 404 to user: Volume ad9ed314-dc9f-42c6-91cf-476b2a383cd4 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:14.153384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-848637c8-63cc-4286-a42f-6679e98c016a tempest-VolumesNegativeTest-1003267915 tempest-VolumesNegativeTest-1003267915-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/ad9ed314-dc9f-42c6-91cf-476b2a383cd4" status: 404 len: 109 microversion: 2.1 time: 0.120472 Aug 12 10:50:14.163291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 3/10] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:14 2022] GET /compute/v2.1/os-volumes/ad9ed314-dc9f-42c6-91cf-476b2a383cd4 => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:50:15.096815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bcd5b44e-a4c2-4dfb-b2ee-8d79c5ac1f8b tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e760310>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:15.180416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bcd5b44e-a4c2-4dfb-b2ee-8d79c5ac1f8b tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 200 len: 354 microversion: 2.1 time: 0.087884 Aug 12 10:50:15.195726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 8/11] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:15 2022] GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:15.311637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ad78a3eb-aa8f-47fd-97f9-253d26699ce5 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e7b2a60>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:15.311637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ad78a3eb-aa8f-47fd-97f9-253d26699ce5 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 200 len: 354 microversion: 2.1 time: 0.101224 Aug 12 10:50:15.311637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 4/12] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:15 2022] GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:15.313257 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-73df013f-3dbc-434f-94d0-90e491d95987 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e760940>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:15.534190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-73df013f-3dbc-434f-94d0-90e491d95987 tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 202 len: 0 microversion: 2.1 time: 0.231751 Aug 12 10:50:15.545001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 9/13] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:50:15 2022] DELETE /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:50:15.555518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3ed0407e-ae9e-4ad4-80f5-dd54576abaeb tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e74f160>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:15.656849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3ed0407e-ae9e-4ad4-80f5-dd54576abaeb tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 200 len: 353 microversion: 2.1 time: 0.116580 Aug 12 10:50:15.658807 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 5/14] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:15 2022] GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:16.671155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e1bfd71d-2c9b-4f76-9183-7c9d878305dd tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Calling method '.version_select at 0x7efc5e76f040>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:16.725436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-e1bfd71d-2c9b-4f76-9183-7c9d878305dd tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] HTTP exception thrown: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e1bfd71d-2c9b-4f76-9183-7c9d878305dd tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Request method failure captured: Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c HTTP/1.1 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jBjWIWa66FHwdtFZUgT5JRCStyTmuEbbprmxjBDHLelMzLojaWgsHQhTvSaHH5-uJL5bNQt-bFaDsjTJMSt6h5T_fPk7_f3RvMp8gYbWxv_pgfD5sqir3SXndBDpDh1qzJQ9Qfj_qxavHB-DgutrZpzQ7MAk_yi4VWcQdFUq-r6Wp0 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 09c9254199eb4abd9cd1f158e8485935 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesGetTestJSON-2135708817 Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:50:16.728117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/09c9254199eb4abd9cd1f158e8485935"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09c9254199eb4abd9cd1f158e8485935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_09c9254199eb4abd9cd1f158e8485935"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/09c9254199eb4abd9cd1f158e8485935"}]}] Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesGetTestJSON-2135708817 Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 09c9254199eb4abd9cd1f158e8485935 Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesGetTestJSON-2135708817 Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesGetTestJSON-2135708817-project Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 39e66fc5b67f4c17af43b6d1fe134dc4 Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesGetTestJSON-2135708817-project Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '7da6d8ab-8ec2-4403-8487-d363114f7a6c'} Aug 12 10:50:16.729311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. (HTTP 404) (Request-ID: req-9ee50c3b-5538-4fe8-9351-322abb5170f6) Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:16.729935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:50:16.730866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 10:50:16.731727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. Aug 12 10:50:16.733729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:50:16.735300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e1bfd71d-2c9b-4f76-9183-7c9d878305dd tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] Returning 404 to user: Volume 7da6d8ab-8ec2-4403-8487-d363114f7a6c could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:50:16.736387 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e1bfd71d-2c9b-4f76-9183-7c9d878305dd tempest-VolumesGetTestJSON-2135708817 tempest-VolumesGetTestJSON-2135708817-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c" status: 404 len: 109 microversion: 2.1 time: 0.069219 Aug 12 10:50:16.737151 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 10/15] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:16 2022] GET /compute/v2.1/os-volumes/7da6d8ab-8ec2-4403-8487-d363114f7a6c => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:50:24.145153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e5afc5c0-c08a-4054-9ff1-4cada9f100c5 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5e7b2940>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:24.234158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e5afc5c0-c08a-4054-9ff1-4cada9f100c5 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a61d3166-c38a-4779-9933-f948287bf43c" status: 200 len: 350 microversion: 2.1 time: 0.093824 Aug 12 10:50:24.244553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 6/16] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:24 2022] GET /compute/v2.1/os-volumes/a61d3166-c38a-4779-9933-f948287bf43c => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:25.655617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1163900293", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:25.947972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] validate_networks() for [('d04db2da-450b-4e62-9b11-b04a9d5232a8', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:50:26.137706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-688af075-9a5d-4b53-9144-b935d89e77ad tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5e7cb940>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:26.204224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-688af075-9a5d-4b53-9144-b935d89e77ad tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/52f99728-d23f-447e-a9a4-1d958e4e410a" status: 200 len: 351 microversion: 2.1 time: 0.072122 Aug 12 10:50:26.213166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 7/17] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:26 2022] GET /compute/v2.1/os-volumes/52f99728-d23f-447e-a9a4-1d958e4e410a => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:27.811673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:50:27.812221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:50:27.812571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:50:27.812974 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:50:27.813374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:50:27.841220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:27.846922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:27.849894 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:27.856456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:27.862004 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:27.864216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:27.949140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:27.964049 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for user 58e209063f5c454d87d9f743bedfc734 and project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:28.016215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:50:28.032539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:50:28.160171 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c53428e1-b25a-419d-ba94-a4b559bb0688 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.852457 Aug 12 10:50:28.161012 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 11/18] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:50:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:50:28.188336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-54970e9a-f1f6-4d14-9a3f-012f0c898d8f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:28.189998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-54970e9a-f1f6-4d14-9a3f-012f0c898d8f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:28.503568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-54970e9a-f1f6-4d14-9a3f-012f0c898d8f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:28.598069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-54970e9a-f1f6-4d14-9a3f-012f0c898d8f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1222 microversion: 2.1 time: 0.428437 Aug 12 10:50:28.599034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 8/19] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:28 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1222 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:28.709264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d34249a0-4aec-43b8-a7ad-a356ad521ffa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: .version_select at 0x7efc5de62b80>, body: {"keypair": {"name": "tempest-keypair-1721208082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBvJUbUIwQn+O/zA5tYo9LDd3MrN/VnV5QcwIulZZ0LLagt01EIZYT+JsCfLqu+VTMIJp3RKb+hLNkY7W3bsS/YQAzH1jzwHUG70+L+nKherb+Ug5VHh0ogAChUPLEeWg=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:28.777555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-d34249a0-4aec-43b8-a7ad-a356ad521ffa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:28.782351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-392287581", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:28.787750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-d34249a0-4aec-43b8-a7ad-a356ad521ffa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:28.908228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d34249a0-4aec-43b8-a7ad-a356ad521ffa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.366902 Aug 12 10:50:28.912744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 12/20] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:50:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:28.984587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-29c1b3f0-6b6b-4385-b4bb-8da6ff9b7bae tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5de628b0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:29.005161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] validate_networks() for [('d04db2da-450b-4e62-9b11-b04a9d5232a8', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:50:29.083854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-29c1b3f0-6b6b-4385-b4bb-8da6ff9b7bae tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/534f06ec-f745-4fb6-91e1-80fb8f7efbba" status: 200 len: 351 microversion: 2.1 time: 0.104220 Aug 12 10:50:29.084551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 13/21] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:50:28 2022] GET /compute/v2.1/os-volumes/534f06ec-f745-4fb6-91e1-80fb8f7efbba => generated 351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:50:29.100646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a401392c-b66a-4947-ac97-9215dfe3af61 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5de62820>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:29.294229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a401392c-b66a-4947-ac97-9215dfe3af61 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.199848 Aug 12 10:50:29.295541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 14/22] 10.222.0.23 () {58 vars in 1134 bytes} [Fri Aug 12 10:50:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:29.310232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c4e0a6ad-26b0-4dd2-9d48-640ca2d1a7b1 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5d6281f0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:29.546661 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c4e0a6ad-26b0-4dd2-9d48-640ca2d1a7b1 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.240389 Aug 12 10:50:29.559411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 15/23] 10.222.0.23 () {58 vars in 1149 bytes} [Fri Aug 12 10:50:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:29.565276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-64fa41fd-e2c8-4ac7-99c2-597e311e7302 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5d628c10>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:29.760707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-64fa41fd-e2c8-4ac7-99c2-597e311e7302 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.199924 Aug 12 10:50:29.761305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 16/24] 10.222.0.23 () {58 vars in 1134 bytes} [Fri Aug 12 10:50:29 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:29.780938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-291fe6ca-8330-4fa3-b39c-1eb352973337 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5de798b0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:29.943209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-291fe6ca-8330-4fa3-b39c-1eb352973337 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.171004 Aug 12 10:50:29.943778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 17/25] 10.222.0.23 () {58 vars in 1167 bytes} [Fri Aug 12 10:50:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:29.960139 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5adf3155-2f81-4517-b65b-f79da11c1f95 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5d624310>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:30.253018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5adf3155-2f81-4517-b65b-f79da11c1f95 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.297824 Aug 12 10:50:30.254650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 18/26] 10.222.0.23 () {58 vars in 1170 bytes} [Fri Aug 12 10:50:29 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:50:30.276329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ee227522-c4ce-454a-ba5d-f3d8e7486e3c tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5de79940>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:30.522420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ee227522-c4ce-454a-ba5d-f3d8e7486e3c tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.253514 Aug 12 10:50:30.523153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 19/27] 10.222.0.23 () {58 vars in 1155 bytes} [Fri Aug 12 10:50:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:30.540699 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a6193245-e950-470b-b8b5-a803d3d7eba7 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5d628af0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:30.782265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a6193245-e950-470b-b8b5-a803d3d7eba7 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.248823 Aug 12 10:50:30.784198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 20/28] 10.222.0.23 () {58 vars in 1188 bytes} [Fri Aug 12 10:50:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:50:30.799032 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4e021f44-3128-482a-ae5b-1ab2a5c34979 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] Calling method '.version_select at 0x7efc5d6291f0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:30.998599 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4e021f44-3128-482a-ae5b-1ab2a5c34979 tempest-VolumesTestJSON-1904227279 tempest-VolumesTestJSON-1904227279-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.203487 Aug 12 10:50:31.013999 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 21/29] 10.222.0.23 () {58 vars in 1155 bytes} [Fri Aug 12 10:50:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:32.457376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:50:32.457838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:50:32.458233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:50:32.458708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:50:32.459207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:50:32.516013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:32.517265 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:32.519894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:32.520954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:32.521713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:32.522458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:32.635709 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:32.650005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for user 58e209063f5c454d87d9f743bedfc734 and project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:32.744636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:50:32.750507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:50:32.982326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cf9d5050-9905-4de2-a817-70293aea3c1d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.205263 Aug 12 10:50:32.987744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 9/30] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:50:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 4212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 10:50:33.004341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7ae4546b-407d-4c73-af9e-4396ad3e46d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:33.006094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7ae4546b-407d-4c73-af9e-4396ad3e46d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:33.591556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7ae4546b-407d-4c73-af9e-4396ad3e46d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:33.628616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7ae4546b-407d-4c73-af9e-4396ad3e46d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1221 microversion: 2.1 time: 0.632542 Aug 12 10:50:33.643123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 22/31] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:32 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1221 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:33.795531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9dd5223d-3009-4835-8f01-031e146aaeee tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: .version_select at 0x7efc5e67d3a0>, body: {"keypair": {"name": "tempest-keypair-1792543490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGfUDNO/PK2Yds6vRPsOZVwEXEHuOGHaX87WWF+nH8PjBVaaqkfpBAprfZcOhGQ5gHcSwFQK4t0QoC4dhiqOz1cPp6mXHMaBnRhh5eX2sXSgM83ISoqU8Iz264EJE7I7YQ=="}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:33.885354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9dd5223d-3009-4835-8f01-031e146aaeee tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:33.896781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9dd5223d-3009-4835-8f01-031e146aaeee tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for user c0711a144b4c4432ab849367d3bd2b33 and project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:33.906268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-764227815", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "networks": [{"uuid": "cc28c927-679c-4fd9-b6a8-3128ef6f440e"}]}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:33.985431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9dd5223d-3009-4835-8f01-031e146aaeee tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.502221 Aug 12 10:50:33.986607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 10/32] 10.222.0.23 () {62 vars in 1200 bytes} [Fri Aug 12 10:50:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 504 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 12 10:50:34.082275 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] validate_networks() for [('cc28c927-679c-4fd9-b6a8-3128ef6f440e', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:50:34.649789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7f22f154-fb96-41fb-bbe9-26ba0994dbe5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:34.650415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7f22f154-fb96-41fb-bbe9-26ba0994dbe5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:35.390890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f22f154-fb96-41fb-bbe9-26ba0994dbe5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:35.422036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7f22f154-fb96-41fb-bbe9-26ba0994dbe5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1221 microversion: 2.1 time: 0.760352 Aug 12 10:50:35.431630 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 11/33] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:34 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1221 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:36.457988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:36.459893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:36.474828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:36.476977 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:36.479012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:36.481140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:36.483469 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:36.484136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:37.695656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:37.719228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bbdd8591-5e29-44e6-88ba-29dd61b51d84 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1279 microversion: 2.1 time: 1.269687 Aug 12 10:50:37.725392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 12/34] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:36 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1279 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:37.911310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:37.912129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:38.040100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-104815340", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4619fc67-f793-4a22-b0bd-06a8104796b2"}], "security_groups": [{"name": "tempest-securitygroup--423637216"}], "key_name": "tempest-keypair-1721208082", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:38.498249 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] validate_networks() for [('4619fc67-f793-4a22-b0bd-06a8104796b2', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:50:38.632536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:50:38.633313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:50:38.634153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:50:38.634770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:50:38.635612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:50:38.665662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:38.668585 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:38.688360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:38.690356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:38.692855 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:38.695594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:38.748238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Getting quotas for project 9475bf21c0234ae5bf55a9c2ba967d33. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:38.757015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Getting quotas for user 5c7c0993b20843e4804fa96cd9be34d1 and project 9475bf21c0234ae5bf55a9c2ba967d33. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:38.793639 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:50:38.797755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:50:38.901515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-21856bd1-b1d5-49de-ab22-10a8a5905dc6 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.136513 Aug 12 10:50:38.902850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 23/35] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:50:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 5139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:50:38.908781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:38.909776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:38.918296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:38.920248 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:38.921134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:38.922157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:38.923287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:38.924017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:40.053921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:50:40.054844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:50:40.055491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:50:40.056045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:50:40.056801 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:50:40.113206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:40.120792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:40.121386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:40.122250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:40.129862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:40.135211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:40.135908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:40.161264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-88be3249-91b2-4050-a434-1146076c3788 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1279 microversion: 2.1 time: 1.257014 Aug 12 10:50:40.176000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 24/36] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:38 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1279 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:40.182731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:40.183490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:40.208048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:40.209091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:40.209601 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:40.214359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:40.216817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:40.217320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:40.218934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:40.220491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:40.257884 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:50:40.265619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:50:40.418632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7da4fc84-c4ed-4853-9d38-446ab64f40e4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.384836 Aug 12 10:50:40.426464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 13/37] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:50:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:50:40.438226 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4991c392-1105-4d74-8475-0859fc04141c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:40.439438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4991c392-1105-4d74-8475-0859fc04141c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:40.485105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:40.493527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a8905ea8-60df-420e-a51a-e3a5c94fb6ad tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1218 microversion: 2.1 time: 0.324636 Aug 12 10:50:40.518341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 25/38] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:40 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1218 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:40.560524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4991c392-1105-4d74-8475-0859fc04141c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:40.574365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4991c392-1105-4d74-8475-0859fc04141c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1241 microversion: 2.1 time: 0.146485 Aug 12 10:50:40.597849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 14/39] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:40 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1241 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:41.187184 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:41.188858 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:41.207538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:41.209221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:41.211013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:41.213264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:41.215342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:41.216100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:41.516214 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:41.517169 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:41.554293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:41.555400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:41.557599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:41.561304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:41.563983 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:41.566228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:42.019744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:42.030121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-81a67a6b-4f7f-4997-98d1-96e2f1fbfdcf tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1274 microversion: 2.1 time: 0.519045 Aug 12 10:50:42.030724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 15/40] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:41 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:42.081703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:42.082375 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:42.110145 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:42.111236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:42.112145 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:42.113685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:42.115523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:42.118849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:42.226570 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:42.235227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-570766d1-1fb6-4960-a43c-076a495aa288 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 1.055321 Aug 12 10:50:42.252680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 26/41] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:41 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:42.297352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:42.307715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-18a62165-9e30-4ae4-b665-321f831766f5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1245 microversion: 2.1 time: 0.254073 Aug 12 10:50:42.308347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 16/42] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:42 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1245 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:43.051949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:43.052806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:43.061667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.064924 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.069278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.071949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.072644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.078443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.259857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:43.260589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:43.280486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.282163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.287147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.288101 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.288750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.290609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.295190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:43.303509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e78c4441-d413-4571-95af-cb4ade670467 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1272 microversion: 2.1 time: 0.255597 Aug 12 10:50:43.308128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 27/43] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:43 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:43.333824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:43.335929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:43.366713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.367125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.367718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.380310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:43.380921 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:43.381372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:43.682183 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:43.691074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a09acdd4-7a3a-4cd2-873b-310aeca3fb32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1293 microversion: 2.1 time: 0.365403 Aug 12 10:50:43.691650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 28/44] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:43 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1293 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:43.909376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:43.924474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6a76fc89-3af8-4544-8577-6678b83f8b9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.667524 Aug 12 10:50:43.925797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 17/45] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:43 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:44.330497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:44.332373 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:44.344459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.352920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.359917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:44.364884 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.365593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.368161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:44.563309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:44.574393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-09b7c4a7-2ca3-4d87-a9ba-02a3f3a179e0 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1272 microversion: 2.1 time: 0.248828 Aug 12 10:50:44.596811 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 29/46] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:44 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:44.714341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:44.718137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:44.732066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.735322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.736997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:44.741344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.742160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.743831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:44.946494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:44.947592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:44.959785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.963654 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.971836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:44.978721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:44.982237 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:44.982830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:45.102257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:45.122796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2a6235d3-0324-467e-8775-918484ba525e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1301 microversion: 2.1 time: 0.412318 Aug 12 10:50:45.128980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 18/47] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:44 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1301 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:45.599439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:45.600122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:45.609842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:45.614717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:45.617005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:45.622369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:45.625112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:45.630476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:45.805954 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:45.816573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7aad948f-307e-430e-9ad4-86d66ba86fe2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.874341 Aug 12 10:50:45.820569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 30/48] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:44 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:46.159037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:46.160494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:46.167426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:46.185267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:46.185942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:46.186843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:46.187446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:46.188019 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:46.488382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:46.496048 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f0b57ba0-7a93-4fca-8ed5-9e49ec57f92f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1299 microversion: 2.1 time: 0.340973 Aug 12 10:50:46.508130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 31/49] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:46 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1299 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:46.523750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:46.535283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-98192b68-a14a-4da6-be2a-eff0b16166f1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.937918 Aug 12 10:50:46.545210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 19/50] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:45 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:46.839076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:46.841173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:46.852203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:46.858580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:46.859755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:46.861448 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:46.862162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:46.863337 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:47.533573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:47.534829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:47.546662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:47.553030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:47.559059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:47.567300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:47.577830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:47.581036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:47.949408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:47.961093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a0f62256-3c0a-4d41-88b2-c23576970cd8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1299 microversion: 2.1 time: 0.431881 Aug 12 10:50:47.961701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 20/51] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:47 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1299 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:47.991366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:47.996825 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:48.023439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:48.023986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:48.024613 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:48.027897 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:48.030351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:48.031298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:48.370190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:48.390377 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-09d4a225-18bf-4838-a319-6459176c2d7a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.411670 Aug 12 10:50:48.409468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 21/52] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:47 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:48.433750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:48.446713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-68550dac-4c97-4c2a-9cfd-fcc3322762c5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 1.609806 Aug 12 10:50:48.448774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 32/53] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:46 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:48.982835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:48.984594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:49.004847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:49.010802 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=18 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:49.025446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.027122 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.028371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.035469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.037976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.039760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.171061 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2b5d19a-4377-43cc-ae14-942386d69b71", "tag": "2f69e421-8efb-40d6-a1be-fed18ae606f2"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:49.228140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.232947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.238195 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.312593 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Creating event network-changed:2f69e421-8efb-40d6-a1be-fed18ae606f2 for instance a2b5d19a-4377-43cc-ae14-942386d69b71 on hv-cinder-85294 Aug 12 10:50:49.314115 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 10:50:49.316645 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-3e771382-73cd-4d62-9b63-ca2ae7b97521 req-c7c753d3-1cce-499d-8340-00878025a300 service nova] Acquired lock "compute-rpcapi-router" {{(pid=132239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 10:50:49.318034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.319189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.319853 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.322458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.324427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.327466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.365077 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.compute.rpcapi [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 10:50:49.365997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] Releasing lock "compute-rpcapi-router" {{(pid=132239) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 10:50:49.420587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-408ca9be-6825-4eee-9035-ba5493fc4a15 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.008003 Aug 12 10:50:49.424036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 22/54] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:49.438665 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:49.441960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:49.468101 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.468704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.469337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.481620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.482412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.483263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.579335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:49.587410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4a87f24c-4252-43dc-8aff-3bad4f39bc7a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.608463 Aug 12 10:50:49.588004 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 33/55] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:48 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:49.608018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:49.613995 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:49.626249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.627016 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.627460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.628190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:49.628670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:49.629096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:49.760534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:49.770758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c3378b8b-71e8-4e71-9879-f887a861bee1 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.345390 Aug 12 10:50:49.771551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 23/56] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:49 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:50.000969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:50.011914 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-66df1d77-0d2c-42dd-9678-43d426bc988f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.407849 Aug 12 10:50:50.015011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 34/57] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:49 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:50.610852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:50.612715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:50.622183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=22 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:50.625599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:50.626925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:50.627614 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:50.629110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:50.629843 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:50.630487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:50.798895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:50.802895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:50.819646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:50.820947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:50.820947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:50.821357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:50.821811 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:50.822209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.159251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:51.167780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3897a06d-bb4a-41e8-aa50-253cbe935f5c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.562699 Aug 12 10:50:51.174341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 24/58] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:50 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:51.183385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-241872374", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76f15494-8bf4-43ef-9f7b-d0448450839d"}], "security_groups": [{"name": "tempest-securitygroup--1830905033"}], "key_name": "tempest-keypair-1792543490", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:51.201559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:51.215054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fbfff5a3-c713-4024-bb32-efc71c03c476 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.419925 Aug 12 10:50:51.216323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 35/59] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:50 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:51.247103 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:51.249738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:51.263246 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.263981 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.265810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.267146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.267860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.280847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.484379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] validate_networks() for [('76f15494-8bf4-43ef-9f7b-d0448450839d', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:50:51.632604 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:51.644112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5e29d51d-1562-4482-8d7c-ec9e8d8f7677 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.408687 Aug 12 10:50:51.645486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 36/60] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:51 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:51.650764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae256ba5-0b07-4359-b737-c287be74cc9e", "tag": "22e33477-1d9d-42cf-8d23-a317fa68555d"}, {"name": "network-changed", "server_uuid": "5968f546-a763-411a-b60d-be95c9345941", "tag": "d954c3b6-203c-41c0-b581-d71c7789bd85"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:51.664739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.665267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.665696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.688632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Creating event network-changed:22e33477-1d9d-42cf-8d23-a317fa68555d for instance ae256ba5-0b07-4359-b737-c287be74cc9e on hv-cinder-85294 Aug 12 10:50:51.689367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Creating event network-changed:d954c3b6-203c-41c0-b581-d71c7789bd85 for instance 5968f546-a763-411a-b60d-be95c9345941 on hv-cinder-85294 Aug 12 10:50:51.689972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132240) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 12 10:50:51.690533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-5f68beb8-103e-4d82-bfa6-4e5227a877a7 req-b4424b14-9329-4c2d-9af3-d2b7c2b6d74e service nova] Acquired lock "compute-rpcapi-router" {{(pid=132240) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 12 10:50:51.692251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.693134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.693753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.694637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.695270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.695864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:51.708609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.compute.rpcapi [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 12 10:50:51.709986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] Releasing lock "compute-rpcapi-router" {{(pid=132240) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 12 10:50:51.735792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7be6b0a4-afe4-4490-9238-03bf0e697c00 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.088822 Aug 12 10:50:51.736555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 37/61] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:51.968074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50312e28-f052-47cc-88c5-34ac69ff9551", "tag": "dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:51.982341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:51.983287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:51.984013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.002806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] Creating event network-changed:dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2 for instance 50312e28-f052-47cc-88c5-34ac69ff9551 on hv-cinder-85294 Aug 12 10:50:52.010029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-140b1121-1cfe-4918-b04e-ac63bfc571f7 req-b441347d-15ee-4c8d-812c-47ede0545499 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271469 Aug 12 10:50:52.011114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 38/62] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:52.035903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:50:52.037926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:50:52.038729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:50:52.039388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:50:52.040040 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:50:52.084512 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.086714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.087994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.090090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.092422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.096385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.118926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:50:52.125052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for user c0711a144b4c4432ab849367d3bd2b33 and project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:50:52.139627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:50:52.142605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:50:52.198243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:52.199008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:52.218470 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.219040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.221307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.223275 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.224628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.225610 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.241406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-039ff90b-ea6a-4119-aef2-142cf97ed376 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.063380 Aug 12 10:50:52.243482 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 25/63] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Aug 12 10:50:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 10:50:52.253274 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:52.253892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:52.269901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:52.275765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.276528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.276968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.277692 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:52.278136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:52.278553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:52.788808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:52.804793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a28f7667-2163-463f-9199-919887ba3eca tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.609041 Aug 12 10:50:52.805980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 39/64] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:52 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:52.817594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:52.824126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:52.937564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:52.952578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:52.959149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:52.962852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6184e828-b425-446d-894f-4d15ae1f9751 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1281 microversion: 2.20 time: 0.155554 Aug 12 10:50:52.964906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 40/65] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:52 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1281 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:50:52.973071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:52.985602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:52.992019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1f8a1c56-1bfb-4dfc-93dc-33daff001b51 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.745732 Aug 12 10:50:52.993385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 26/66] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:52 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:52.995454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:53.017794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:53.021148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:53.022913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:53.024815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:53.025708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:53.026981 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:53.425035 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:53.437003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d2f840b7-be03-42cf-bb25-ec30c47ab7cc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.470567 Aug 12 10:50:53.438851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 41/67] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:52 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:53.829518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:53.832523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:53.845180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:53.845937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:53.846394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:53.847085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:53.853961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:53.854633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:53.993780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:53.995017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:54.005001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.005762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.006361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.007804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.008750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.009324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.017191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:54.048227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.056904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dfa5a03d-92cb-4e2b-bf70-6316be7d0505 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.231868 Aug 12 10:50:54.073073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 27/68] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:53 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:54.078068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:54.078711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:54.086978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.088242 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.088846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.089719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.090771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.091372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.111201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.120144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.121655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.122755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9e7e6c79-90ab-4754-97c9-4b9743738467 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1341 microversion: 2.20 time: 0.136383 Aug 12 10:50:54.123311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 42/69] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:53 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1341 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:50:54.282052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.285147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=87 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:54.302903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-452221a2-e4ce-4187-abc1-ad5d3f61e416 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.228500 Aug 12 10:50:54.315134 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 28/70] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:54 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:54.474312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:54.477065 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:54.487594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.488713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.491206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.501287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:54.503034 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:54.507266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:54.727263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:54.736018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0bacf136-f5a2-41bd-a5ee-ff9d85b10497 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.271493 Aug 12 10:50:54.736865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 43/71] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:54 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:55.079250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:55.080087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:55.090217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.090958 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.091687 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.092921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.093561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.094416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.152144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:55.153496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:55.161141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.162564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.163513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.164421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.164917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.166162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.265406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.274480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.276196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.277528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fc051842-6522-4939-a6c6-1a5d24220044 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1341 microversion: 2.20 time: 0.131096 Aug 12 10:50:55.278833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 44/72] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:55 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1341 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:50:55.296126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.305753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-11ba4089-5602-480e-8841-dd3f12ca846a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.232220 Aug 12 10:50:55.306794 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 29/73] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:55 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:55.323504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:55.324456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:55.326330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:50:55.334745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.335484 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.335920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.336836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.337491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.338107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.487028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.495726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-62f2c00b-57e5-47b2-bd02-014695ecde1a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.176435 Aug 12 10:50:55.496495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 45/74] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:55 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:55.757570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:55.758181 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:55.765054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.765669 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.766203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.767859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:55.767859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:55.768525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:55.961194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:55.969743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f6b34cc9-a317-47c2-90ee-e47d86ff0626 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.215873 Aug 12 10:50:55.970250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 30/75] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:55 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:56.306646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:56.307498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:56.316286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.316780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.317215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.319366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.319824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.320252 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.330250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:56.332142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:56.338693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.339724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.340458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.342322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.342995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.343787 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.394965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:56.403844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:56.406529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:56.408068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-300a1e53-c34f-4a54-bb89-8c65151f5086 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1341 microversion: 2.20 time: 0.112825 Aug 12 10:50:56.423751 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 46/76] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:56 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1341 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:50:56.517731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:56.519121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:56.525435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.526141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.526991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.527927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:56.528613 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:56.529023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:56.529445 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:56.538351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5e04b35d-af76-4c80-bb28-ff580e283440 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.213235 Aug 12 10:50:56.539262 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 31/77] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:56 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:56.678762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:56.686118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1304251e-0598-418f-883f-3770b08f87ac tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.172199 Aug 12 10:50:56.691902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 47/78] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:56 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:50:56.993531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:56.994034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:57.004173 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.004810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.005365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.006137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.006680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.007146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.246552 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:57.264382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c62cc66e-a28d-42be-9bf0-f924465e9815 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.277014 Aug 12 10:50:57.267585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 32/79] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:56 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:57.438746 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:57.441686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:57.481314 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.481897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.482351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.483094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.483550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.492530 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.633942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b5d19a-4377-43cc-ae14-942386d69b71", "name": "network-vif-plugged", "status": "completed", "tag": "2f69e421-8efb-40d6-a1be-fed18ae606f2"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:50:57.657881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.662814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.663573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.707248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] Creating event network-vif-plugged:2f69e421-8efb-40d6-a1be-fed18ae606f2 for instance a2b5d19a-4377-43cc-ae14-942386d69b71 on hv-cinder-85294 Aug 12 10:50:57.713459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-861be378-67f4-4284-b7dd-4036d43796a0 req-9bee408c-a21c-452a-8051-31261ac15e31 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187963 Aug 12 10:50:57.714705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 33/80] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:50:57.722035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:57.723022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:57.731290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.731939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.732712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.733768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.734386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.735757 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.744803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:57.755877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:57.757499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:57.758613 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6e05213e-92f3-4ddb-b3cc-0610f640de04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1341 microversion: 2.20 time: 0.331826 Aug 12 10:50:57.774053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 48/81] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:57 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1341 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:50:57.778848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:57.779453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:57.787818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.788774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.789200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:57.790085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:57.790614 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:57.790893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:58.020683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:58.030313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7bcb1c39-c656-4b67-8580-ea8cd59ea922 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.255092 Aug 12 10:50:58.030892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 49/82] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:57 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:58.040449 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:58.043257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ee02bc09-553d-44ed-916e-4d1257257dc7 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.326050 Aug 12 10:50:58.043890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 34/83] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:57 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:58.289162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:58.290065 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:58.296919 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:58.297797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:58.298496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:58.299275 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:58.299796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:58.300306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:58.478168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:58.492684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6886d6c1-57cb-443d-8dda-8dbcccbb9584 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.203841 Aug 12 10:50:58.493732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 50/84] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:58 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:58.785540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:58.786086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:58.792630 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:58.796438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:58.796922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:58.797847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:58.798531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:58.801753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.051341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:59.051955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:59.066099 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.066607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.067127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.067852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.072446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.073250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.340809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.350904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.353297 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.354575 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-90127c8c-4774-43db-880b-54b7601826cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1339 microversion: 2.20 time: 0.577539 Aug 12 10:50:59.355293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 35/85] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:50:58 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1339 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:50:59.380465 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:59.383238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:59.401521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.403187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.404035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.404987 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.405792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.419480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.511930 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.522253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-51e054fb-2eae-4ced-a219-cc5eb8c18250 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.474913 Aug 12 10:50:59.526542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 51/86] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:59 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:59.537108 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:50:59.538681 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:50:59.554600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.555105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.555543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.556291 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:50:59.560990 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:50:59.561457 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:50:59.812053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.821978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-51429333-cd10-498a-ae81-37cf16f3fabb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.465029 Aug 12 10:50:59.823207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 36/87] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:59 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:50:59.877305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:50:59.885604 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-20d636d0-70da-43f5-af4e-db71b4894f98 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.357689 Aug 12 10:50:59.886282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 52/88] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:50:59 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:00.143858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1976665593", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "networks": [{"uuid": "4ede6356-cd3a-4161-a89c-27f593b4f964"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:00.239414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] validate_networks() for [('4ede6356-cd3a-4161-a89c-27f593b4f964', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:51:00.380633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:00.381463 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:00.388940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.389724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.390326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.391188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.392151 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.393012 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.676666 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:00.691162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:00.692935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:00.694374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f1a98b2f-b76b-4430-989e-d060c729f78b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.319257 Aug 12 10:51:00.695338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 53/89] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:00 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:51:00.714472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:00.715657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:00.724466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.725083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.727920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.736554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.737056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.737480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.902624 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:51:00.903622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:51:00.904283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:51:00.904921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:51:00.905467 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:51:00.915671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.916397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.916895 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.919719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:00.922209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:00.923646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:00.931240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=9 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:00.944570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Getting quotas for project 7795fcb0687b47aab64c34d161d24856. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:51:00.949442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Getting quotas for user d17fb4b6648e436ab20481059f81600a and project 7795fcb0687b47aab64c34d161d24856. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:51:00.954716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:00.965761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e21697e9-aa04-4e62-b3b5-a8f2a9153a3d tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.269071 Aug 12 10:51:00.969237 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:51:00.992455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 54/90] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:00 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:00.999019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:51:01.005380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:01.006964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:01.020923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.021684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.022498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.023872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.024572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.025455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.148956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-45bc1c26-5986-408a-8af5-9312d36005fb tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009675 Aug 12 10:51:01.155658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 37/91] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:51:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:51:01.163209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:01.166964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:01.175568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.176156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.176750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.177503 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.178024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.178556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.220645 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:01.231659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-63936336-9055-4ec4-8c41-1909c9967d09 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.236783 Aug 12 10:51:01.251607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 55/92] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:00 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:01.260790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:01.277180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.277916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.278750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.294541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] Creating event network-changed:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:51:01.303312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-ffa258fc-16dc-40f0-b0bd-f174dfff989f req-4b30152a-9eaf-479c-856d-c858d8ca7fc0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045125 Aug 12 10:51:01.305183 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 56/93] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:01.314005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b5a4b0df-213c-4c9f-9ee7-23e533d5db92 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:01.315102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b5a4b0df-213c-4c9f-9ee7-23e533d5db92 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:01.434071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b5a4b0df-213c-4c9f-9ee7-23e533d5db92 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:01.443080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b5a4b0df-213c-4c9f-9ee7-23e533d5db92 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1214 microversion: 2.1 time: 0.134632 Aug 12 10:51:01.444660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 57/94] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:01 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1214 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:01.577135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:01.595037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-daa3121f-69f0-48e8-b343-17d6a6223e9d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.437936 Aug 12 10:51:01.599372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 38/95] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:01 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:01.694140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae256ba5-0b07-4359-b737-c287be74cc9e", "name": "network-vif-plugged", "status": "completed", "tag": "22e33477-1d9d-42cf-8d23-a317fa68555d"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:01.727744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:01.728410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:01.742088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:01.746154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.746648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.747094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.747824 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.748305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.756172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:01.756713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:01.757153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.758579 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:01.791594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] Creating event network-vif-plugged:22e33477-1d9d-42cf-8d23-a317fa68555d for instance ae256ba5-0b07-4359-b737-c287be74cc9e on hv-cinder-85294 Aug 12 10:51:01.799778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c52a7beb-0067-4ce4-aa8c-be896132ae5a req-d5f34271-51ac-49b9-988e-e12064e71770 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111320 Aug 12 10:51:01.801362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 58/96] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:02.000140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:02.004015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.004762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:02.017693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.019898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.021070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-70c1cb92-d4b8-43db-b035-4cd4c1507ff0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.303435 Aug 12 10:51:02.021649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 39/97] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:01 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:51:02.039332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.040030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.040643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.041698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.043180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.043834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.261380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:02.262768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:02.273844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.274117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.274765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.275814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.277346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.278010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.312131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.324423 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ed652d7f-7a74-4b1e-9ebe-667f23d44afb tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.336630 Aug 12 10:51:02.325289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 59/98] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:01 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:02.464174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:02.465089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:02.471833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.472667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.473196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.474096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.474543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.475090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.493009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.507468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0814e6c9-a869-4cd1-bcf7-dde0539297e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.253379 Aug 12 10:51:02.508499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 40/99] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:02 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:02.555664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.576825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9f422323-86a0-4af0-86a3-ca6a87bd9913 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1210 microversion: 2.1 time: 0.117280 Aug 12 10:51:02.577716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 60/100] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:02 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:02.619329 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:02.619935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:02.627585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.628065 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.628693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.629592 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:02.630178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:02.630747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:02.898872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:02.911224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8634c626-ff8f-4db8-afef-c3b833fecc07 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.295765 Aug 12 10:51:02.911840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 41/101] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:02 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:03.045992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:03.046672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:03.068569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.069508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.070637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.072011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.073957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.076516 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.123202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:03.346749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:03.347499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:03.357229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.367330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.368725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.371485 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.371981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.372568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.373286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.373726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.374149 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.375115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f0a2a71d-6b58-4aa0-a40f-a50ed408f66c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.328121 Aug 12 10:51:03.393888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 61/102] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:03 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:03.530854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:03.532398 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:03.539188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.539968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.540833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.541735 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.542254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.542743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.543437 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.553771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-88ee895f-a48d-4fe5-bbb5-f18b547c699e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.211896 Aug 12 10:51:03.566943 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 42/103] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:03 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:03.601945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:03.604038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:03.612178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.612981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.614101 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.615245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.616004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.616873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.727678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.738011 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d1d0b9bc-c846-43e8-aa7e-60a990ac3205 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1266 microversion: 2.1 time: 0.142760 Aug 12 10:51:03.739010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 43/104] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:03 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1266 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:03.769269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:03.779905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-29074f0d-7932-4ac1-8a68-0893a831b05a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.252897 Aug 12 10:51:03.781867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 62/105] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:03 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:03.826679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5968f546-a763-411a-b60d-be95c9345941", "name": "network-vif-plugged", "status": "completed", "tag": "d954c3b6-203c-41c0-b581-d71c7789bd85"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:03.838245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.838726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.839349 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.850623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] Creating event network-vif-plugged:d954c3b6-203c-41c0-b581-d71c7789bd85 for instance 5968f546-a763-411a-b60d-be95c9345941 on hv-cinder-85294 Aug 12 10:51:03.855779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-ca8e46fe-7191-46dd-b57e-8071e58593b1 req-1f0c9719-2778-4af0-95fd-6ce62d4d16be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035184 Aug 12 10:51:03.856585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 44/106] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:03.936963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:03.937727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:03.943754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.944409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.944924 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:03.945690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:03.946206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:03.946794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.094291 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.103546 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9690442e-9864-4451-aa07-4c353d6caecb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.170400 Aug 12 10:51:04.104381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 63/107] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:03 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:04.402994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:04.403693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:04.410226 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.410778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.411213 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.411902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.412370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.413225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.559753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.571494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.574740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.576440 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1887ce1e-fac0-4eba-a006-688a53a3372e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.178629 Aug 12 10:51:04.577067 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:04.577585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 45/108] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:04 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:04.577710 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:04.585342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.585825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.589419 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.597259 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.597764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.598204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.740658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.751204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1d42f5c7-08db-42b6-a142-b79ce5a7ed0a tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.178516 Aug 12 10:51:04.754572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 64/109] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:04 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:04.771026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:04.771678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:04.778583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.779071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.779504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.780408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.780961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.781276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.805221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:04.814913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:04.824358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.824882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.825376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.826131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:04.826581 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:04.827179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:04.876651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:04.876651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8788bd54-111b-4b32-bad6-8edd460c1ed4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1266 microversion: 2.1 time: 0.110001 Aug 12 10:51:04.881149 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 46/110] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:04 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:05.080676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:05.089878 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5f6bac67-6c29-40c1-b204-45688273ef78 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.289885 Aug 12 10:51:05.101295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 65/111] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:04 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:05.127581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:05.128274 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:05.141280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.142733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.144768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:05.145961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.147484 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.148647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:05.199339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=100 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:05.490302 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:05.502057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e1b4c02a-c650-40a0-9bc1-e10763282fdd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1321 microversion: 2.1 time: 0.379843 Aug 12 10:51:05.504915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 47/112] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:05 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1321 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:05.602249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:05.602859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:05.614481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.614988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.617389 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:05.620155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.620702 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.621143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:05.778064 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:05.779434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:05.789333 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.790323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.791103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:05.792178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:05.792926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:05.793527 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.145797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.155070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.156825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.158328 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9d3f0fec-364a-428e-bceb-d2f89eac376f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.560363 Aug 12 10:51:06.159240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 66/113] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:05 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:06.162615 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.164748 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:06.165552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:06.172656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.173503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.174182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.175114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.175752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.175998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b181e531-3bff-4f78-b953-340f2b07f407 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.403242 Aug 12 10:51:06.176590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.177008 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 48/114] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:05 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:06.183717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50312e28-f052-47cc-88c5-34ac69ff9551", "name": "network-vif-plugged", "status": "completed", "tag": "dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:06.194443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.194916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.195529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.207881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] Creating event network-vif-plugged:dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2 for instance 50312e28-f052-47cc-88c5-34ac69ff9551 on hv-cinder-85294 Aug 12 10:51:06.213255 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-c79134a8-394a-414f-ad30-7d421064c99f req-e44d45f6-0adb-440e-b674-6209d43351e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034970 Aug 12 10:51:06.213856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 49/115] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:06.221822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:06.222520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:06.228674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.229111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.229549 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.230243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.230695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.231119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.264707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.272997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e5b8eed4-43c4-4d55-baf0-bfa73b15aaaf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1272 microversion: 2.1 time: 0.112209 Aug 12 10:51:06.273444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 67/116] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:06 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:06.429853 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.437723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2e59e3ed-7dd7-4768-ac76-86e0243d0e80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.219880 Aug 12 10:51:06.438552 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 50/117] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:06 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:06.527926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:06.528587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:06.535049 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.535628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.536133 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.536929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:06.537448 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:06.542834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:06.968282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:06.989472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3d421d11-9ff1-4b11-9455-99f31c5c4f6d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1515 microversion: 2.1 time: 0.465295 Aug 12 10:51:06.994229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 68/118] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:06 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1515 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:07.014296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:07.017410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.024679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.025453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.026098 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.027056 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.027629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.028300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.114180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'flavor' on Instance uuid ae256ba5-0b07-4359-b737-c287be74cc9e {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:07.181776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:07.183437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.204293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.204863 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.205454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.206327 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.206784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.207215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.268912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-744ace72-e816-4923-916c-d72ea34195f7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e/action" status: 200 len: 32 microversion: 2.1 time: 0.258873 Aug 12 10:51:07.270197 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 51/119] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:51:07 2022] POST /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:51:07.275687 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:07.276643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.283702 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.284494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.284923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.285631 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.286082 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.286500 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.397300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.405199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.406674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.407977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9e197d67-7fc9-49c0-9f98-8a688230a995 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.230429 Aug 12 10:51:07.408553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 69/120] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:07 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:07.413033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:07.413789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.426638 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.427286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.427724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.428497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.428985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.429436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.447279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.472489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b285bcba-3273-46dd-b335-43590c0f6f02 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.200510 Aug 12 10:51:07.473508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 52/121] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:07 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:07.488457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:07.491022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.498100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.498806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.499537 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.500409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.501168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.502137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.665128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.673278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fa0c4fa5-e7bd-4e59-8d4d-2144daa8a6af tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.263432 Aug 12 10:51:07.674048 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 70/122] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:07 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:07.679441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:07.680229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:07.686263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.687068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.687757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.688682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:07.688862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.689143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:07.689624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:07.696771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-97293f80-7f33-4090-93a9-5fed889a083d tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.222021 Aug 12 10:51:07.697346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 53/123] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:07 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:07.822060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:07.834497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cfed2445-1a86-4cca-a0e2-6fee763927f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.159088 Aug 12 10:51:07.835331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 71/124] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:07 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:08.233978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "name": "network-vif-plugged", "status": "completed", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:08.244378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.244850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.245271 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.256785 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] Creating event network-vif-plugged:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:51:08.261672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-0969ae58-195d-4cc2-b9ef-e9c9c1981fb7 req-cd9d9c3e-f7b6-432f-9dbc-b1a1a61dbebb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Aug 12 10:51:08.262299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 54/125] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:08.433903 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:08.434763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:08.443819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.444609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.445231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.446188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.446823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.447418 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.494150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:08.494852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:08.501115 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.501595 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.502220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.502944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.503394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.503813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.639646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.648224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.649752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.650849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-49794b45-5bd8-497a-bb16-15231924140f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.222584 Aug 12 10:51:08.651550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 72/126] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:08 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:08.671248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.679177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-20cc861a-cfc8-4937-90c9-a068fa733045 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.189328 Aug 12 10:51:08.679740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 55/127] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:08 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:08.694446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:08.695051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:08.700997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.701463 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.701886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.702557 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.702995 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.703407 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.717928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:08.718864 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:08.725600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.726060 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.726487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.727193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.727642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.728054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.894970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.902635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0446f723-047c-4775-a4cf-aca7745f890e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.211958 Aug 12 10:51:08.903191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 73/128] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:08 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:08.907567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:08.908242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:08.908873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:08.914104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f57695b0-a7a9-4aaf-bd97-e803de1019f7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.200417 Aug 12 10:51:08.914591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.915065 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 56/129] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:08 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:08.920161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.920756 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:08.921543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:08.922206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:08.922808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.066655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:09.075437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f559760a-1213-4cab-81af-2c49e9c16528 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.171218 Aug 12 10:51:09.076001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 74/130] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:08 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:09.673014 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:09.673704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:09.679945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.680481 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.680913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.681601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.682040 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.682482 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.708505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:09.708505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:09.708505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.708505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.709181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.709181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.709181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.709181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.920214 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:09.925124 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:09.930095 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:09.931614 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:09.932786 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1a4f618d-7981-4a12-b117-7b3164f9047a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.263708 Aug 12 10:51:09.933821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 57/131] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:09 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:09.936042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d3ae6e5f-d0d4-4340-901c-716b28b5417c tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1314 microversion: 2.1 time: 0.240504 Aug 12 10:51:09.936992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 75/132] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:09 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:09.942540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:09.943381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:09.952289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:09.952975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:09.953116 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.953577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.954104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.954894 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.955581 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.956077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.959784 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.960316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.960952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:09.961655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:09.962105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:09.962531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.163167 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:10.173129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:10.174252 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c1077a88-981c-4cbb-8167-122c54b43b1f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.236022 Aug 12 10:51:10.175675 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 76/133] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:09 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:10.180602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:10.181380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:10.181679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7160dde8-a58b-4c86-b731-afd5d67a0d9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.246636 Aug 12 10:51:10.182661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 58/134] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:09 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:10.187183 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.187655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.188076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.188861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.189424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.189825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.322842 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:10.326219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:10.331006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ab1606ee-ffc5-40af-941d-a13e0f5b446b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1366 microversion: 2.1 time: 0.153959 Aug 12 10:51:10.331565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 77/135] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:10 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:10.955081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:10.955691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:10.957168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:10.957785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:10.958822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:10.959625 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=12 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:10.965150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.965639 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.966075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.966279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.966785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.967123 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.967236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.967663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.967804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:10.968694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:10.969150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:10.969593 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.274947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.283555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.292799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.295078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.295728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cb0d43a2-a807-4f94-abfb-1cf446f4cba5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1500 microversion: 2.1 time: 0.342216 Aug 12 10:51:11.296792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 78/136] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:10 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1500 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:11.302546 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:11.303442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:11.309601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-85e326d1-6991-4d02-8188-a1f1447757de tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.358390 Aug 12 10:51:11.325321 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 59/137] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:10 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:11.332016 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:11.335932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.339003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:11.341405 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.347662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.348600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.349376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.350380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.354037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.354504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.355088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.357411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.357939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.358530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.440528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=4 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:11.651549 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.658296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.660411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1a57dd04-7880-4d5a-b3cd-28026c9e2a40 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.362265 Aug 12 10:51:11.661345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 79/138] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:11 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:11.675120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d899560f-08bc-4108-840c-a2a9fcf09b74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.344296 Aug 12 10:51:11.676672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 60/139] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:11 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:11.679569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:11.680178 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:11.699030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.699671 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.700240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.701113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.701694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.702408 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.740699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40a9faa1-4c48-4a6f-84d0-de6aca97af75", "tag": "b868f6e7-33b6-4d50-b864-224938faf4a8"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:11.753185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.754037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.754599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.768520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] Creating event network-changed:b868f6e7-33b6-4d50-b864-224938faf4a8 for instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 on hv-cinder-85294 Aug 12 10:51:11.774324 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-4df99be6-ebce-4c90-9038-c759f9a01de4 req-16e11070-7c62-407c-be41-5768f93c9edf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044156 Aug 12 10:51:11.775213 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 61/140] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:51:11.900214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:11.908603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a1b8a7f4-b294-4ee8-a310-d10cc8655624 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1557 microversion: 2.1 time: 0.233047 Aug 12 10:51:11.909172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 80/141] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:11 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1557 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:11.930814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:11.931397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:11.937807 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.938306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.938909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:11.939668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:11.940146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:11.940604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:12.017292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ca53198f-5252-4b4e-8e1e-459c834d7f48 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090699 Aug 12 10:51:12.017869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 62/142] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:51:11 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:12.336963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:12.337580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:12.348795 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:12.349770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:12.350348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:12.351790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:12.352452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:12.353657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:12.681809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:12.682701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:12.695393 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:12.695909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:12.696334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:12.703525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:12.704132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:12.704674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:13.129824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:13.137882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:13.139527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:13.140669 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-36348a5b-b6a2-43a5-ae27-fb07343d9866 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1407 microversion: 2.20 time: 0.810568 Aug 12 10:51:13.141203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 81/143] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:12 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1407 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:13.147301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:13.147871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:13.154878 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:13.155564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:13.155988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:13.156726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:13.157153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:13.158597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:13.245003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:13.256620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8f9f4113-5347-4d21-aaeb-822c3e14495f tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.578374 Aug 12 10:51:13.257627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 63/144] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:12 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:13.263887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52a559dd-04ca-46c5-a2df-929af7fecfbc"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:13.267913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:13.284604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:13.286631 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:13.287342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:13.288421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:13.289104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:13.289866 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:13.305752 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:13.463504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:13.475333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4351d317-4508-4d0e-b309-6d019e61c993 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.331974 Aug 12 10:51:13.476249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 82/145] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:13 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:13.993419 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50312e28-f052-47cc-88c5-34ac69ff9551", "tag": "dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:14.003719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.004294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.004934 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.017996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] Creating event network-changed:dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2 for instance 50312e28-f052-47cc-88c5-34ac69ff9551 on hv-cinder-85294 Aug 12 10:51:14.023737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-f3189748-ac63-4c0d-a7a2-feec563d2faf req-cdbe4aea-5df6-461f-811b-9498be06f121 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033998 Aug 12 10:51:14.025066 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 83/146] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:14.167054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:14.168316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:14.175550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.176030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.176488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.177362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.177804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.178252 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.371447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:14.382673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:14.401725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:14.417494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cc061644-e1c3-4be9-804f-f71a08838047 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1600 microversion: 2.20 time: 0.255692 Aug 12 10:51:14.418132 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 84/147] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:51:14 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1600 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:51:14.445525 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:14.446279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:14.468567 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.470291 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.474357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.475619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.476235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.478005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.668620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f13b36fb-0f23-4526-bf08-96c90b5a5d53 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "POST /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.408951 Aug 12 10:51:14.669229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 64/148] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:51:13 2022] POST /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941/os-volume_attachments => generated 194 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:14.689058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:14.690596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:14.706764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.709999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.710941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.711845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.712471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.721321 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.780662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:14.795642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e9531d15-b8fd-4b8a-bfd3-f2836c564f09 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.375566 Aug 12 10:51:14.796583 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 85/149] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:14 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:14.806865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:14.807723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:14.815059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.815915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.816691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.817625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:14.818271 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:14.818942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:14.986687 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1b45e7cc-c8f7-4204-a57d-a2a45f991e42 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.303785 Aug 12 10:51:14.987852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 65/150] 10.222.0.23 () {60 vars in 1316 bytes} [Fri Aug 12 10:51:14 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-interface => generated 285 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:51:15.069261 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:15.078193 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-10f17c9a-458c-4008-84d1-bd811fa444aa tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.278553 Aug 12 10:51:15.079168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 86/151] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:14 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:15.819466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:15.820075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:15.829637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:15.830118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:15.830540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:15.835648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:15.836120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:15.836594 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:16.007130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:16.015759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d15d2240-1165-44eb-bd5a-06689c0a27b9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.200546 Aug 12 10:51:16.017399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 66/152] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:15 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:16.099277 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:16.100948 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:16.107254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:16.107734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:16.108386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:16.109087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:16.109530 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:16.109978 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:16.267816 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:16.273817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-010eea4c-3563-4b4a-abb2-a9a83ad57264 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.178463 Aug 12 10:51:16.275124 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 87/153] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:16 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:16.803872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:16.816603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:16.817076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:16.817501 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:16.828633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] Creating event network-changed:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:51:16.834528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d9b8c236-79df-4f50-8464-4ad710e0c845 req-8d4b9690-b040-441d-a724-4fad32fb5145 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036373 Aug 12 10:51:16.835287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 67/154] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:17.039350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:17.040679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:17.050145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:17.050843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:17.051497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:17.052433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:17.053362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:17.054002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:17.265326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:17.290502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3c267d09-3cc0-499b-96d3-2e98b77391ae tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.245492 Aug 12 10:51:17.298898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:17.300154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:17.303509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 88/155] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:17 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:17.306837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:17.307323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:17.307743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:17.308683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:17.310021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:17.310691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:17.540928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:17.550939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4cd62af7-0bda-4cc9-b23a-1589c3a0eb73 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.258058 Aug 12 10:51:17.556339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 68/156] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:17 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:18.327211 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:18.327831 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:18.334653 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:18.335206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:18.335638 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:18.336429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:18.336827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:18.337253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:18.475219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:18.482755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-308b9b79-1866-4d5f-8186-0874fd667732 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.160575 Aug 12 10:51:18.483332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 89/157] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:18 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:18.574505 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:18.575126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:18.578799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:18.582988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:18.583521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:18.584147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:18.584914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:18.585346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:18.585866 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:18.744084 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:18.753553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5b3421fd-58df-4f42-bd9b-6b42d08952a0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.182786 Aug 12 10:51:18.754134 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 69/158] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:18 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:19.170988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9faa1-4c48-4a6f-84d0-de6aca97af75", "name": "network-vif-plugged", "status": "completed", "tag": "b868f6e7-33b6-4d50-b864-224938faf4a8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:19.181948 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:19.182425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:19.182860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:19.200597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] Creating event network-vif-plugged:b868f6e7-33b6-4d50-b864-224938faf4a8 for instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 on hv-cinder-85294 Aug 12 10:51:19.208519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-cf8bc91c-4af3-44b6-8bf6-ac6c6b33d93f req-9460de8f-e5c6-4f76-99b3-398e177f747d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042155 Aug 12 10:51:19.209686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 90/159] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:19.504129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:19.505023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:19.512345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:19.512793 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:19.513234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:19.513952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:19.514418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:19.514911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:19.667862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:19.675954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3187ae39-a937-4d55-b61c-3bdfe3a8aab4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.176492 Aug 12 10:51:19.676622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 70/160] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:19 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:19.776179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:19.776893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:19.783337 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:19.783823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:19.784319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:19.785020 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:19.785476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:19.785930 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:19.923805 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:19.932072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-46b26aca-58c0-468f-b6ac-b5ca8c97d247 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.160003 Aug 12 10:51:19.939382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 91/161] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:19 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:20.697925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:20.698552 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:20.706219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:20.706722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:20.707154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:20.707970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:20.708458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:20.708883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:20.856660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:20.865028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5bcd435e-94d1-44aa-9bb3-8472e5a4cfd2 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1314 microversion: 2.1 time: 0.171391 Aug 12 10:51:20.865632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 71/162] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:20 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:20.953243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:20.954628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:20.961237 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:20.961808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:20.962334 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:20.963161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:20.963806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:20.964432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:21.127228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:21.138473 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bd10ee5c-e6f9-4b9b-ac6b-5127eca3770e tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.188491 Aug 12 10:51:21.139401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 92/163] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:20 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:21.891654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:21.892834 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:21.902204 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:21.902975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:21.903394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:21.904267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:21.904726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:21.905144 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:22.075316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:22.084491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-50c25773-48df-48dc-a57e-29112d8fbf65 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1498 microversion: 2.1 time: 0.199779 Aug 12 10:51:22.085306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 72/164] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:21 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1498 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:22.163275 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:22.164227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:22.172408 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:22.173065 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:22.173566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:22.174382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:22.174900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:22.175324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:22.367205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:22.377672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7521a480-8413-4258-b861-5f7fa9d06725 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.221071 Aug 12 10:51:22.378316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 93/165] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:22 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:22.952831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:22.954382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:22.961498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:22.961983 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:22.962450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:22.963150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:22.963598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:22.964021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:22.994406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:51:23.081378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9e34a1f7-f4ff-4e9c-9040-0e99d3468088 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "DELETE /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 204 len: 0 microversion: 2.1 time: 0.132708 Aug 12 10:51:23.081997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 73/166] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:51:22 2022] DELETE /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:51:23.090135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:23.090734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:23.092707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:23.098196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:23.098788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:23.099294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:23.100298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:23.100743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:23.101152 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:23.249620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:23.257550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fee5cbc5-6641-41ac-934d-b4f326b37f08 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1504 microversion: 2.1 time: 0.171207 Aug 12 10:51:23.258130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 94/167] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:23 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:23.399854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:23.400602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:23.407283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:23.407945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:23.408635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:23.409185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:23.409651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:23.410060 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:23.550160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:23.557879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6ca99f98-2ff5-4b6a-b08b-6f1547d9505a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.162189 Aug 12 10:51:23.558462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 74/168] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:23 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:24.279003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:24.279683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:24.286949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:24.287438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:24.287870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:24.288589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:24.289043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:24.289443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:24.448490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:24.455384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:24.463285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cea4ad18-381c-443b-b782-13c47a2a56a1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1504 microversion: 2.1 time: 0.185616 Aug 12 10:51:24.463902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 95/169] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:24 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:24.579370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:24.580097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:24.586888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:24.587407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:24.588295 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:24.588991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:24.589686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:24.590224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:24.748708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:24.756567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3cc5928e-68a7-43bd-9882-f9e3fa698231 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.181283 Aug 12 10:51:24.757143 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 75/170] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:24 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:25.485772 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:25.486540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:25.492915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:25.493476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:25.493980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:25.494767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:25.495424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:25.495929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:25.641268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:25.649238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dbceb17c-7a2a-402f-a284-2887fe805887 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1504 microversion: 2.1 time: 0.167856 Aug 12 10:51:25.649888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 96/171] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:25 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:25.780823 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:25.781629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:25.788844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:25.789586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:25.790261 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:25.791199 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:25.792113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:25.792753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:25.943440 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:25.951178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2576c964-4dc0-441b-b247-a17dea90debd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.176666 Aug 12 10:51:25.951754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 76/172] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:25 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:26.671154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:26.671760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:26.677987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:26.678464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:26.678870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:26.679745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:26.680196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:26.680641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:26.837598 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:26.853574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2ea37239-852c-45a8-9b04-8e59a5d8edbf tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1504 microversion: 2.1 time: 0.183450 Aug 12 10:51:26.854612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 97/173] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:26 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:26.979074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:26.979074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:26.983729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:26.984651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:26.985252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:26.986100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:26.986711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:26.987415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.147078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:27.156467 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3cda2469-64d9-44ad-9426-fd2545279bd9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.187586 Aug 12 10:51:27.157292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 77/174] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:26 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:27.515360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40a9faa1-4c48-4a6f-84d0-de6aca97af75", "name": "network-vif-deleted", "tag": "b868f6e7-33b6-4d50-b864-224938faf4a8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:27.525609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.526093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.526600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.537917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] Creating event network-vif-deleted:b868f6e7-33b6-4d50-b864-224938faf4a8 for instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 on hv-cinder-85294 Aug 12 10:51:27.542909 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-cf3449d9-5d37-4147-87af-ec6236a22bed req-1649ce0b-c579-470e-af95-0e3616570e63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Aug 12 10:51:27.543514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 98/175] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:27.678844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:27.679690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:27.685674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.686153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.686581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.687269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.687745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.688165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.720840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:51:27.733916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:27.809227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6458d756-365d-483a-9ed6-801c49599bce tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 204 len: 0 microversion: 2.1 time: 0.133987 Aug 12 10:51:27.809831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 78/176] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:51:27 2022] DELETE /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:51:27.819621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:27.822786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:27.830861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.831344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.832381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.832474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.832901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.833501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.876476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:27.877331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:27.883728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.884231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.884706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.885413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.885901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.886326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.920844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:27.921713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:27.922168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:27.922730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 40a9faa1-4c48-4a6f-84d0-de6aca97af75 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:27.979699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:27.988089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-36c5251f-5992-4f5c-8cae-35cead6c43ce tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1304 microversion: 2.1 time: 0.116124 Aug 12 10:51:27.988754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 79/177] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:27 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:28.002474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:28.010967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9d1ee925-1e1f-4fa6-a034-a780834f0ca3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1552 microversion: 2.1 time: 0.195548 Aug 12 10:51:28.011531 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 99/178] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:27 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:28.178340 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:28.178967 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:28.185314 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:28.185807 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:28.186246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:28.186937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:28.187399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:28.187822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:28.338845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:28.346929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ae666f54-f0d9-4eaa-a47c-458ef24de9b9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.172571 Aug 12 10:51:28.347519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 80/179] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:28 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:29.010149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:29.010747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:29.017454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.018996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.019663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.020396 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.020847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.021263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.033294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:29.034292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:29.041097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.041576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.042026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.042673 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.043114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.043551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.052430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.052905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.053365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.053830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 40a9faa1-4c48-4a6f-84d0-de6aca97af75 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:29.107268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:29.114993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d701c3c6-9e7e-4697-a3c1-d7b70c8956e4 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1304 microversion: 2.1 time: 0.108979 Aug 12 10:51:29.115777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 100/180] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:29 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:29.197883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:29.207168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3b6631af-6da9-4103-bdee-3dacce122f13 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1552 microversion: 2.1 time: 0.178079 Aug 12 10:51:29.207772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 81/181] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:29 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:29.373295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:29.373909 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:29.380679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.381158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.381590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.382276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:29.382725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:29.383164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:29.527001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:29.536214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3295e8d7-eb5f-4fd3-b11a-edac59b8d45f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.166743 Aug 12 10:51:29.537267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 101/182] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:29 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:30.136979 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:30.137557 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:30.145003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.145478 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.145922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.146581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.147041 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.147455 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.178216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.178685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.179110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.179543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 40a9faa1-4c48-4a6f-84d0-de6aca97af75 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:30.223670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:30.230581 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:30.231088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:30.233887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-03d5a80c-48d0-4b0a-b797-862221213eb3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1304 microversion: 2.1 time: 0.100672 Aug 12 10:51:30.234711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 82/183] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:30 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:30.238316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.238832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.239268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.239980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.240461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.240885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.379283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:30.387908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a1e934ac-ca6c-4772-a726-b354867cc5df tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1552 microversion: 2.1 time: 0.163022 Aug 12 10:51:30.388548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 102/184] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:30 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:30.562176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:30.563047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:30.573444 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.574300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.574988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.576125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:30.576937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:30.577658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:30.716388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:30.726832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a9b442e0-9ad4-4816-bffe-7dfa9445b1d1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.171253 Aug 12 10:51:30.727547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 83/185] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:30 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:31.258269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:31.258846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:31.265364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.265876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.266285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.266987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.267436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.267864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.300693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.301155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.301585 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.302094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 40a9faa1-4c48-4a6f-84d0-de6aca97af75 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:31.346677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:31.355213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-304e0f42-f06a-42e1-bc3d-e5cba29ce4df tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1304 microversion: 2.1 time: 0.101307 Aug 12 10:51:31.355784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 103/186] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:31 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:31.410144 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:31.410788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:31.418253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.418772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.419201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.419891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.420398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.420821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.558666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:31.567523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c03d4f96-1dab-4614-850e-9be4bd06d2c3 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1552 microversion: 2.1 time: 0.161422 Aug 12 10:51:31.568093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 84/187] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:31 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:31.751006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:31.751884 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:31.760831 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.761509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.762112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.763076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:31.763706 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:31.764308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:31.907560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:31.915660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ca4dbd92-e21d-4197-bb15-dfc2919757fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.170175 Aug 12 10:51:31.916204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 104/188] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:31 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:32.375284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:32.375910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:32.382059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.382665 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.383202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.383893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.384375 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.384803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.417668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.418457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.418725 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.419182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 40a9faa1-4c48-4a6f-84d0-de6aca97af75 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:32.468367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:32.480452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7f403a3e-ad1c-48bc-b992-9a7ee235dfdc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 200 len: 1304 microversion: 2.1 time: 0.108780 Aug 12 10:51:32.481193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 85/189] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:32 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:32.589357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:32.589945 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:32.596426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.596901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.597331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.598012 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.598451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.598868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.740408 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:32.748583 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7a461663-e62c-4170-9b89-b351569c705e tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1552 microversion: 2.1 time: 0.163263 Aug 12 10:51:32.749411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 105/190] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:32 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:32.937827 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:32.938792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:32.948994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.950944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.954874 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:32.955747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:32.957294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:32.958104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.114513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:33.122460 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-54e14080-9133-40be-ae66-e6bbcf12e8e2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.189462 Aug 12 10:51:33.123059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 86/191] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:32 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:33.505982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:33.506849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 40a9faa1-4c48-4a6f-84d0-de6aca97af75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:33.513544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:33.514028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:33.514452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.515140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:33.515584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:33.515999 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.530245 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] HTTP exception thrown: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Request method failure captured: Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 HTTP/1.1 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jCSb6U7SX_SVrIfOjsKDaqlfQVUz4up9P_BGHdvBiHSNpyMQNa1oC_XiToJ5T8qyQl-kpQV9y0USX2TrkFlqeQaeNvf-nN_u3cjkBXDFtUvIOMv5o3GzHjkJOKGzp4WV-LQCDfn3EjVg8BirQPYJcFAn39x6K357BV1NjfELzKM9K8 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 7795fcb0687b47aab64c34d161d24856 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesActionsTest-226456970 Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:51:33.534888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7795fcb0687b47aab64c34d161d24856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7795fcb0687b47aab64c34d161d24856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7795fcb0687b47aab64c34d161d24856"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7795fcb0687b47aab64c34d161d24856"}]}] Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesActionsTest-226456970 Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 7795fcb0687b47aab64c34d161d24856 Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesActionsTest-226456970 Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesActionsTest-226456970-project Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d17fb4b6648e436ab20481059f81600a Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesActionsTest-226456970-project Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. Aug 12 10:51:33.536305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '40a9faa1-4c48-4a6f-84d0-de6aca97af75'} Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:51:33.537075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. Aug 12 10:51:33.538382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:33.539545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Returning 404 to user: Instance 40a9faa1-4c48-4a6f-84d0-de6aca97af75 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:51:33.539545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-054ce5f2-d95f-4819-aaea-61affd922112 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75" status: 404 len: 111 microversion: 2.1 time: 0.034276 Aug 12 10:51:33.539545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 106/192] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:33 2022] GET /compute/v2.1/servers/40a9faa1-4c48-4a6f-84d0-de6aca97af75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:51:33.661122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1749833323", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "networks": [{"uuid": "4ede6356-cd3a-4161-a89c-27f593b4f964"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:33.735403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5968f546-a763-411a-b60d-be95c9345941", "name": "network-vif-deleted", "tag": "d954c3b6-203c-41c0-b581-d71c7789bd85"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:33.745975 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:33.746145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:33.746535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.760039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] Creating event network-vif-deleted:d954c3b6-203c-41c0-b581-d71c7789bd85 for instance 5968f546-a763-411a-b60d-be95c9345941 on hv-cinder-85294 Aug 12 10:51:33.765576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-a9827739-dcdb-4532-8faf-738f6a7042dc req-a791c58c-c51e-450a-b7f3-5fa99bf93535 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033904 Aug 12 10:51:33.766313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 107/193] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:51:33.772399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:33.773340 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:33.779713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:33.780187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:33.780642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.781332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:33.781771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:33.782188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:33.855385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:33.864052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3ecb26aa-dfa0-4756-8347-916b38ec3e12 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1510 microversion: 2.1 time: 0.096524 Aug 12 10:51:33.864618 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 108/194] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:33 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1510 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:34.147976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:34.149211 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:34.155826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:34.156372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:34.156814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:34.157517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:34.157966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:34.158380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:34.305356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:34.313273 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ef0fd092-3ffa-4291-b8c6-2da2b3b39408 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.172549 Aug 12 10:51:34.313913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 109/195] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:34 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:34.889391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:34.890499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:34.899982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:34.900501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:34.900925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:34.901611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:34.902053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:34.902461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:34.968232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:34.976146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-071ac45a-06be-450c-8b66-bfe27546f796 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1510 microversion: 2.1 time: 0.093194 Aug 12 10:51:34.976799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 110/196] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:34 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:35.333958 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:35.334648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:35.342308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:35.342793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:35.343221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:35.343920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:35.344391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:35.344840 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:35.487186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:35.495228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-022fd3e9-8c5d-4fef-94c2-301aca1757c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.165282 Aug 12 10:51:35.495773 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 111/197] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:35 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:36.002233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:36.004330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:36.015513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:36.016239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:36.016696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:36.017407 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:36.017855 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:36.018271 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:36.094605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:36.103527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5f804b74-f908-4abe-93fa-65e06157dc99 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1510 microversion: 2.1 time: 0.107084 Aug 12 10:51:36.104730 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 112/198] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:35 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1510 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:36.520991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:36.522129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:36.532787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:36.533596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:36.534315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:36.535472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:36.536538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:36.537332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:36.700189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:36.703969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:36.709007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-32b78bd4-5ea2-45df-a279-727357db7c2a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.195067 Aug 12 10:51:36.709566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 113/199] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:36 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:37.124964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:37.125587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:37.131770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:37.132250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:37.132707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:37.133492 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:37.134329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:37.134329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:37.203767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c7c0993b20843e4804fa96cd9be34d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9475bf21c0234ae5bf55a9c2ba967d33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:37.213242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-066c6e83-fc8c-4106-822d-bb158afb7ad5 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 200 len: 1345 microversion: 2.1 time: 0.091636 Aug 12 10:51:37.214103 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 114/200] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:37 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 1345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:37.732349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:37.733309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:37.739829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:37.740282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:37.740892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:37.741645 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:37.742230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:37.742656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:37.884098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:37.897033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9ee5f58c-eb5a-4317-925d-55c035830e6a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.169868 Aug 12 10:51:37.897781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 115/201] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:37 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:38.236627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:38.237504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:38.246006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.246663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.247209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:38.248116 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.248750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.249304 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:38.265401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] HTTP exception thrown: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Request method failure captured: Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 HTTP/1.1 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5NKGic7myXg2Ydm2ZpfuWM6wbqtAI-w1PjrPZr_rrxX71EGfiIowyM5IIkGhRm5EJhvy5jzuIOF0pL3187mo7hfkpnQFiQGkj09RZojcExH8vf9cke4Wp0oyK5WxiQ7wfCFpGLmLG1jqLlg9IO6uL5b2wHz9njVwoI7m14mkJdoI Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:51:38.267046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}] Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5c7c0993b20843e4804fa96cd9be34d1 Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.268303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '5968f546-a763-411a-b60d-be95c9345941'} Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:51:38.269346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.270507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.271574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Returning 404 to user: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:51:38.271574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d9105a7f-aa30-454c-bb34-54c80515c00f tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 404 len: 111 microversion: 2.1 time: 0.037289 Aug 12 10:51:38.271574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 116/202] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:38 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:51:38.394130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:38.396567 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:38.402708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.403196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.403631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:38.404344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.404767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.405186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:38.451248 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] HTTP exception thrown: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Request method failure captured: Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941/os-volume_attachments HTTP/1.1 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5NKGic7myXg2Ydm2ZpfuWM6wbqtAI-w1PjrPZr_rrxX71EGfiIowyM5IIkGhRm5EJhvy5jzuIOF0pL3187mo7hfkpnQFiQGkj09RZojcExH8vf9cke4Wp0oyK5WxiQ7wfCFpGLmLG1jqLlg9IO6uL5b2wHz9njVwoI7m14mkJdoI Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:51:38.452857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}] Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5c7c0993b20843e4804fa96cd9be34d1 Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.454198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'server_id': '5968f546-a763-411a-b60d-be95c9345941'} Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:51:38.455098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:38.456128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:38.459944 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Returning 404 to user: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:51:38.459944 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-be5bd128-2429-4299-a2ee-d5433cabcad2 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064524 Aug 12 10:51:38.459944 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 117/203] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:51:38 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941/os-volume_attachments => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:51:38.929526 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:38.930512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:38.941701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.942494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.943203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:38.944683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:38.945722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:38.946723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:39.093322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:39.101518 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1766f811-e5fc-45b2-9e87-0072e9f092c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.178796 Aug 12 10:51:39.102080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 118/204] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:38 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:39.680533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:39.681174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:39.688115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:39.688932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:39.689366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:39.690076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:39.690525 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:39.690938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:39.705486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] HTTP exception thrown: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Request method failure captured: Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 HTTP/1.1 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5NKGic7myXg2Ydm2ZpfuWM6wbqtAI-w1PjrPZr_rrxX71EGfiIowyM5IIkGhRm5EJhvy5jzuIOF0pL3187mo7hfkpnQFiQGkj09RZojcExH8vf9cke4Wp0oyK5WxiQ7wfCFpGLmLG1jqLlg9IO6uL5b2wHz9njVwoI7m14mkJdoI Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:51:39.707062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}] Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5c7c0993b20843e4804fa96cd9be34d1 Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.708307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '5968f546-a763-411a-b60d-be95c9345941'} Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:51:39.709110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.710615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.711674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Returning 404 to user: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:51:39.711674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d072c749-47ae-4568-a045-c7e926308a78 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "DELETE /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 404 len: 111 microversion: 2.1 time: 0.031967 Aug 12 10:51:39.711674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 119/205] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:51:39 2022] DELETE /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:51:39.717877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:39.718487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] [instance: 5968f546-a763-411a-b60d-be95c9345941] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:39.724692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:39.725175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:39.726990 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:39.727715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:39.728603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:39.728727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:39.744401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] HTTP exception thrown: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Request method failure captured: Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 HTTP/1.1 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5NKGic7myXg2Ydm2ZpfuWM6wbqtAI-w1PjrPZr_rrxX71EGfiIowyM5IIkGhRm5EJhvy5jzuIOF0pL3187mo7hfkpnQFiQGkj09RZojcExH8vf9cke4Wp0oyK5WxiQ7wfCFpGLmLG1jqLlg9IO6uL5b2wHz9njVwoI7m14mkJdoI Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:51:39.745935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_9475bf21c0234ae5bf55a9c2ba967d33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/9475bf21c0234ae5bf55a9c2ba967d33"}]}] Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 9475bf21c0234ae5bf55a9c2ba967d33 Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-DeleteServersTestJSON-1904529957 Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5c7c0993b20843e4804fa96cd9be34d1 Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-DeleteServersTestJSON-1904529957-project Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.747321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '5968f546-a763-411a-b60d-be95c9345941'} Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:51:39.747993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. Aug 12 10:51:39.749102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:51:39.751192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] Returning 404 to user: Instance 5968f546-a763-411a-b60d-be95c9345941 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:51:39.752240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ef5de913-685c-4a7b-bbf2-fd874ddb8147 tempest-DeleteServersTestJSON-1904529957 tempest-DeleteServersTestJSON-1904529957-project] 10.222.0.23 "GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941" status: 404 len: 111 microversion: 2.1 time: 0.038618 Aug 12 10:51:39.753646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 120/206] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:39 2022] GET /compute/v2.1/servers/5968f546-a763-411a-b60d-be95c9345941 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:51:40.122987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:40.123717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:40.129906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:40.130404 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:40.130832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:40.131519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:40.131977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:40.132491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:40.277332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:40.285309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-966780cb-c831-4f6c-bcae-9996015e2692 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.166525 Aug 12 10:51:40.285897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 121/207] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:40 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:40.560140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] validate_networks() for [('4ede6356-cd3a-4161-a89c-27f593b4f964', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:51:40.956234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:51:40.956891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:51:40.957567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:51:40.958466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:51:40.959047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:51:40.973598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:40.974354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:40.974842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:40.975515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:40.975940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:40.976533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:41.007856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Getting quotas for project 7795fcb0687b47aab64c34d161d24856. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:51:41.015306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Getting quotas for user d17fb4b6648e436ab20481059f81600a and project 7795fcb0687b47aab64c34d161d24856. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:51:41.028344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:51:41.031504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:51:41.095223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cf8358c4-a86c-44bd-830a-a79975b40e8b tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.438015 Aug 12 10:51:41.096246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 87/208] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:51:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 7440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:51:41.110554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-74dbacbc-da27-4a66-a034-cfea50b0cd63 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:41.111605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-74dbacbc-da27-4a66-a034-cfea50b0cd63 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:41.179324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-74dbacbc-da27-4a66-a034-cfea50b0cd63 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:41.187804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-74dbacbc-da27-4a66-a034-cfea50b0cd63 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1214 microversion: 2.1 time: 0.084117 Aug 12 10:51:41.191797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 122/209] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:41 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:41.306052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:41.306962 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:41.313283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:41.313849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:41.314365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:41.315165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:41.315721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:41.316248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:41.506510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:41.517727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-83030577-4ea6-470b-ac1c-0ba0b4d92a79 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.215191 Aug 12 10:51:41.519313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 88/210] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:41 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:42.209863 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:42.210397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:42.216767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:42.217244 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:42.217673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:42.218389 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:42.218836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:42.219250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:42.307073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:42.315143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f674326c-178c-4fdd-8dcb-9454c5aedb60 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1218 microversion: 2.1 time: 0.109267 Aug 12 10:51:42.315729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 123/211] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:42 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:42.540072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:42.540889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:42.548160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:42.548730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:42.549165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:42.549856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:42.550308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:42.550729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:42.694104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:42.704206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0942da93-49e9-4bcd-86b8-002099b755a3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.168900 Aug 12 10:51:42.716662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 89/212] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:42 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:43.336660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:43.337243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:43.344731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:43.345859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:43.346471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:43.347220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:43.347877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:43.348317 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:43.414239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:43.422914 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4d2de607-45e4-417d-962f-22889a5ace55 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1218 microversion: 2.1 time: 0.090600 Aug 12 10:51:43.436429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 124/213] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:43 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:43.725163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:43.726189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:43.732532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:43.733018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:43.734769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:43.734769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:43.734769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:43.735091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:43.894019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:43.901630 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-db110201-fa54-49b4-b40c-cba6f46343d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.180529 Aug 12 10:51:43.902205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 90/214] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:43 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:44.445860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:44.447283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:44.455401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:44.456044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:44.456650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:44.457347 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:44.457939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:44.458217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:44.526449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:44.534803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2f11a2f6-c27a-4ba6-ab73-074a46ca8420 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1210 microversion: 2.1 time: 0.093381 Aug 12 10:51:44.535367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 125/215] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:44 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:44.922566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:44.923210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:44.929980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:44.930499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:44.930938 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:44.931718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:44.932201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:44.932632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:45.075275 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:45.082691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7d9e6b1b-28b4-4e07-9257-10dd5358f3fe tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.163960 Aug 12 10:51:45.083259 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 91/216] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:44 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:45.556700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:45.557327 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:45.564953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:45.565441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:45.565884 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:45.566610 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:45.567056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:45.567477 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:45.654959 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:45.658453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d4dd6c17-5b84-45f1-9544-ddec3c14ae22 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1272 microversion: 2.1 time: 0.102659 Aug 12 10:51:45.658453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 126/217] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:45 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:46.104296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:46.105140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:46.112461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:46.112998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:46.113429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:46.114128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:46.114575 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:46.114992 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:46.412708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:46.421177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7f5587b3-d73c-4ec8-9bef-d1375c40bd39 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.320791 Aug 12 10:51:46.421770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 92/218] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:46 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:46.678120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:46.679411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:46.688249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:46.688768 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:46.689426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:46.690574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:46.691625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:46.692966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:46.850964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:46.858745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dd779d4a-ade1-472e-b233-c9d65e56516a tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.185105 Aug 12 10:51:46.859422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 127/219] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:46 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:47.030220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f6282ba-c416-4acb-be70-d08e9982941a", "tag": "825e10f5-f475-4c70-89d2-33df5970a65c"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:47.039836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:47.040431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:47.041031 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:47.052347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] Creating event network-changed:825e10f5-f475-4c70-89d2-33df5970a65c for instance 6f6282ba-c416-4acb-be70-d08e9982941a on hv-cinder-85294 Aug 12 10:51:47.057576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-81060ecc-bb7f-442d-83d9-ccb96d116005 req-a64d9285-0e83-4465-b008-fca6672f9bcd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030916 Aug 12 10:51:47.058082 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 93/220] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:47.442148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:47.442991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:47.453620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:47.454256 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:47.454859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:47.455724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:47.456427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:47.456809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:47.601781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:47.610301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cd65ac0c-9416-4ea0-ad33-40cc1a1f0868 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.172155 Aug 12 10:51:47.610877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 128/221] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:47 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:47.882113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:47.882868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:47.890083 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:47.890658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:47.891211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:47.891907 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:47.892394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:47.892862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:47.909109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:48.051617 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:48.060974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8577b5eb-7b9e-47f5-9a14-656a054d7b69 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.183884 Aug 12 10:51:48.072858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 94/222] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:47 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:48.631451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:48.632084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:48.639913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:48.640426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:48.640861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:48.641569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:48.642017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:48.642455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:48.788860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:48.796705 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e1376ef4-13fe-4104-bdca-50bd737ca072 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.169369 Aug 12 10:51:48.802605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 129/223] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:48 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:49.094172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:49.094925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:49.097395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:49.104800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:49.105445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:49.107184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:49.107184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:49.107184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:49.107892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:49.255072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:49.266583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-551eab89-c52b-4064-b74a-16496baad7c3 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.176158 Aug 12 10:51:49.267515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 95/224] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:49 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:49.817440 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:49.818018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:49.824081 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:49.824814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:49.825243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:49.825946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:49.826628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:49.826790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:50.044954 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:50.058367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-46033f3f-9508-4b23-9799-e8d3b3e3cdf6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.244417 Aug 12 10:51:50.059391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 130/225] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:49 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:50.290975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:50.292705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:50.300042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:50.301335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:50.302172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:50.303159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:50.303836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:50.304492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:50.539863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:50.548532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-97cf7a71-a956-44fd-bb24-dfd4d1bf5d97 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.263192 Aug 12 10:51:50.561751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 96/226] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:50 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:51.080814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:51.081644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:51.089096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:51.089597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:51.090065 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:51.091112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:51.091559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:51.092637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:51.192684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:51.259332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:51.276015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4b32ea01-ff27-41dd-b523-a107e086ca9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.200345 Aug 12 10:51:51.276756 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 131/227] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:51 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:51.517562 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6282ba-c416-4acb-be70-d08e9982941a", "name": "network-vif-plugged", "status": "completed", "tag": "825e10f5-f475-4c70-89d2-33df5970a65c"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:51.524678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:51.525561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:51.531131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:51.531606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:51.532847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:51.556980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] Creating event network-vif-plugged:825e10f5-f475-4c70-89d2-33df5970a65c for instance 6f6282ba-c416-4acb-be70-d08e9982941a on hv-cinder-85294 Aug 12 10:51:51.570575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:51.571432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:51.583539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:51.584182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:51.585451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:51.587182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:51.588642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:51.589733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:51.591993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-77a41ab3-1dc8-4f57-8155-9a759a8d71fd req-3902c50e-72b6-4470-b333-9675b81a3c97 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078115 Aug 12 10:51:51.593541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 97/228] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:51:51.799399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:51.809286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-29d1bdd3-2bba-4704-b02e-269a3d9a607e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.243470 Aug 12 10:51:51.811991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 132/229] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:51 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:52.305580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:52.306406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:52.315527 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:52.317167 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:52.317841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:52.319294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:52.320051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:52.320693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:52.480492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:52.511429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-976ad98b-d37e-475b-ad5a-4762cef230a6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.209991 Aug 12 10:51:52.528888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 98/230] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:52 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:52.835828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:52.836569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:52.844698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:52.845174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:52.845630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:52.846337 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:52.847715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:52.848154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:53.025208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:53.039332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6fbac8cf-b380-4f91-9de2-993becf26116 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.206871 Aug 12 10:51:53.039937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 133/231] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:52 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:53.537234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:53.539264 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:53.551012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:53.551511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:53.551954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:53.553367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:53.553997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:53.554800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:53.723759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:53.732870 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c4599ef9-d549-4882-a15a-827871125fce tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.200439 Aug 12 10:51:53.733676 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 99/232] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:53 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:54.062947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:54.063616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:54.066090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=86 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:54.072351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:54.073628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:54.074283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:54.075055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:54.075977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:54.076493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:54.082436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:51:54.236164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:54.244167 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7f410615-97bc-4cc7-85c6-16b3cc6796ee tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1314 microversion: 2.1 time: 0.186291 Aug 12 10:51:54.245123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 134/233] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:54 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:54.761201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:54.761814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:54.794022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:54.795236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:54.795839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:54.796716 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:54.797499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:54.798212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:55.025058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:55.034508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2d336de9-1325-4409-8f4d-f58faa2096e8 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1521 microversion: 2.1 time: 0.280904 Aug 12 10:51:55.038385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 100/234] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:54 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:55.267844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:55.269655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:55.279088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:55.281150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:55.281788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:55.282721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:55.283318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:55.283889 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:55.471674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:55.489967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a28266e0-08d2-478c-baae-b31e52c1a2c7 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1498 microversion: 2.1 time: 0.226704 Aug 12 10:51:55.490606 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 135/235] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:55 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1498 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:56.058883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:56.060754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:56.068782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.069530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.070201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.070951 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.071582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.072186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.264917 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:56.284321 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-84cf524e-6846-4c5a-9d06-b0dfe11ce05a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1501 microversion: 2.1 time: 0.229676 Aug 12 10:51:56.285211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 101/236] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:56 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1501 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:56.304829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:56.306262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:56.313797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:56.314719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:56.315474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.316397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.317173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.318674 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.319578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.320356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.322279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.322849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.323945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.324689 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.325151 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.325706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.356193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:51:56.490435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ebaed724-00ad-4cbe-8f43-dbee36c230f9 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 204 len: 0 microversion: 2.1 time: 0.181481 Aug 12 10:51:56.491028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 102/237] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:51:56 2022] DELETE /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:51:56.501003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:56.501925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:56.509267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.510004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.510619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.512005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:56.512627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:56.513235 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:56.559095 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:56.570140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1500c79c-4985-4bfc-ae12-f1331f506f85 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1516 microversion: 2.1 time: 0.269375 Aug 12 10:51:56.571355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 136/238] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:56 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:56.726981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:56.736993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a020c9f3-d941-4a4f-bd30-e8ce6a6b83bc tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1504 microversion: 2.1 time: 0.240749 Aug 12 10:51:56.738161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 103/239] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:56 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1504 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:51:57.758247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:57.758941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:57.765217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:57.765926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:57.766360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:57.767046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:57.767496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:57.767902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:57.913448 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:57.921841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6ac13ac0-f641-4041-92dc-12671e763723 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1504 microversion: 2.1 time: 0.167421 Aug 12 10:51:57.932394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 137/240] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:57 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:58.071927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:58.074281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:58.083855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.084506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.085700 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:58.087999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.088957 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.089566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:58.117174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'flavor' on Instance uuid a2b5d19a-4377-43cc-ae14-942386d69b71 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:51:58.204251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b93be38c-4b2a-49e9-ba9b-6025f2c77d42 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/action" status: 200 len: 32 microversion: 2.1 time: 0.136271 Aug 12 10:51:58.205030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 104/241] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:51:58 2022] POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/action => generated 32 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 10:51:58.215756 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:58.216417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:58.223184 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.223694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.224121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:58.224923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.225411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.225826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:58.394775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:58.402425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bd726fae-de99-466b-bbec-23c727b1e9f0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.191571 Aug 12 10:51:58.402998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 138/242] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:58 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:58.944836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:58.945843 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:58.952771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.953398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.953909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:58.954791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:58.955230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:58.956123 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:59.110722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:59.121803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a24df319-5495-4f12-b3d1-bf8292071d4e tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1504 microversion: 2.1 time: 0.182172 Aug 12 10:51:59.122784 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 105/243] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:58 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:51:59.409240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f6282ba-c416-4acb-be70-d08e9982941a", "name": "network-vif-deleted", "tag": "825e10f5-f475-4c70-89d2-33df5970a65c"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:51:59.426556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:51:59.427168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:51:59.427748 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:59.428844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:59.429395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:59.443050 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:59.447238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:59.449718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:59.451576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:51:59.454310 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:51:59.456509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] Creating event network-vif-deleted:825e10f5-f475-4c70-89d2-33df5970a65c for instance 6f6282ba-c416-4acb-be70-d08e9982941a on hv-cinder-85294 Aug 12 10:51:59.456642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:51:59.461789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c37103ad-1a71-4dc0-8162-eb892778a0e9 req-b61043ef-20a3-4d36-bca8-669a3e74ba6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057734 Aug 12 10:51:59.462523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 139/244] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:51:59.625318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:51:59.633925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dd29f797-17ae-40f6-befa-2acf036dff52 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.213505 Aug 12 10:51:59.635493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 106/245] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:51:59 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:00.145270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:00.146945 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:00.160883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:00.160883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:00.160883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:00.160883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:00.161260 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:00.161260 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:00.208849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:00.209339 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:00.209769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:00.210208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lazy-loading 'fault' on Instance uuid 6f6282ba-c416-4acb-be70-d08e9982941a {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:52:00.266759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17fb4b6648e436ab20481059f81600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7795fcb0687b47aab64c34d161d24856', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:00.277476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0fe8b65d-09b7-41de-b32a-069d54dda2c5 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 200 len: 1304 microversion: 2.1 time: 0.136602 Aug 12 10:52:00.278499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 140/246] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:00 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:00.656076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:00.656803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:00.663441 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:00.663923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:00.664379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:00.665137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:00.665585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:00.665997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:00.836051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:00.845042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-80712312-4478-4681-9aa1-e814e83cceee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.192750 Aug 12 10:52:00.845633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 107/247] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:00 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:01.298631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:01.299250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] [instance: 6f6282ba-c416-4acb-be70-d08e9982941a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:01.305306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:01.305783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:01.306202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:01.306892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:01.307407 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:01.308017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:01.321364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] HTTP exception thrown: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Request method failure captured: Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a HTTP/1.1 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jCSb6U7SX_SVrIfOjsKDaqlfQVUz4up9P_BGHdvBiHSNpyMQNa1oC_XiToJ5T8qyQl-kpQV9y0USX2TrkFlqeQaeNvf-nN_u3cjkBXDFtUvIOMv5o3GzHjkJOKGzp4WV-LQCDfn3EjVg8BirQPYJcFAn39x6K357BV1NjfELzKM9K8 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 7795fcb0687b47aab64c34d161d24856 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesActionsTest-226456970 Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:52:01.323054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/7795fcb0687b47aab64c34d161d24856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7795fcb0687b47aab64c34d161d24856"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_7795fcb0687b47aab64c34d161d24856"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/7795fcb0687b47aab64c34d161d24856"}]}] Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesActionsTest-226456970 Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 7795fcb0687b47aab64c34d161d24856 Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesActionsTest-226456970 Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesActionsTest-226456970-project Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d17fb4b6648e436ab20481059f81600a Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesActionsTest-226456970-project Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. Aug 12 10:52:01.324673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '6f6282ba-c416-4acb-be70-d08e9982941a'} Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:52:01.325358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. Aug 12 10:52:01.326458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:52:01.327494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] Returning 404 to user: Instance 6f6282ba-c416-4acb-be70-d08e9982941a could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:52:01.327494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2501e223-7893-4e54-b6db-1f37500db4d1 tempest-VolumesActionsTest-226456970 tempest-VolumesActionsTest-226456970-project] 10.222.0.23 "GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a" status: 404 len: 111 microversion: 2.1 time: 0.029860 Aug 12 10:52:01.327494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 141/248] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:01 2022] GET /compute/v2.1/servers/6f6282ba-c416-4acb-be70-d08e9982941a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:52:01.872955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:01.873576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:01.881324 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:01.881812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:01.882245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:01.883469 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:01.883934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:01.884388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:01.913728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:02.342015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:02.350511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-35b778d9-223b-49dd-8099-46ab00fe9de9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.487116 Aug 12 10:52:02.351421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 108/249] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:01 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:03.371658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:03.372302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:03.378381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:03.378861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:03.379288 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:03.379972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:03.380455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:03.380875 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:03.558086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:03.565869 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3d83b11c-1cdb-43dc-a542-8610e0ab53a4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.198142 Aug 12 10:52:03.566433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 142/250] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:03 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:04.586499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:04.587102 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:04.593833 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:04.594314 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:04.594753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:04.595470 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:04.595919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:04.596370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:04.731661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:04.740494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-eaaeca7c-37bc-4508-b122-4c51f25f69d7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.157871 Aug 12 10:52:04.741073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 109/251] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:04 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:05.762923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:05.763543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:05.770804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:05.771433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:05.771895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:05.772644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:05.773121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:05.773551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:05.909728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:05.917406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1621f6bb-9244-4aab-86c7-07088367d899 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.159797 Aug 12 10:52:05.917930 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 143/252] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:05 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:06.938723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:06.939932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:06.949088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:06.949660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:06.950217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:06.951033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:06.951690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:06.952296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:07.197352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:07.207104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-94d437f4-0d26-4138-b49d-e39774933ca0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.273023 Aug 12 10:52:07.209956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 110/253] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:06 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:08.238991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:08.241340 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:08.252086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:08.253118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:08.255204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:08.256647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:08.258478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:08.261031 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:08.575458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:08.592367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-db7e95f4-d824-4f74-822d-79c442c97391 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.360778 Aug 12 10:52:08.593470 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 144/254] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:08 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:09.615606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:09.617135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:09.632273 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:09.632746 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:09.633195 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:09.634155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:09.634389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:09.636471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:09.823363 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:09.834642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dbb012b3-3827-4e42-a5c2-902a5bee1655 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.223554 Aug 12 10:52:09.835208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 111/255] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:09 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:10.865571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:10.866341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:10.878069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:10.878806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:10.879392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:10.880249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:10.880867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:10.881489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:11.050735 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:11.059261 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1f377c9e-d124-4e7e-9d1a-9f9146b2a9d2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.197995 Aug 12 10:52:11.060521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 145/256] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:10 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:12.081387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:12.082588 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:12.090249 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:12.091111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:12.091548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:12.092471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:12.092922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:12.093499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:12.233080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:12.240827 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a7cb70eb-11f2-4c04-9dd3-4b40a5b74ad3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.163423 Aug 12 10:52:12.241395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 112/257] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:12 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:13.021678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1839607021", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "networks": [{"uuid": "748b9a03-d496-4b62-90fd-ab4a8de0c910"}]}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:13.089728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] validate_networks() for [('748b9a03-d496-4b62-90fd-ab4a8de0c910', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:52:13.262265 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:13.263995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:13.299584 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:13.300174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:13.300711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:13.302130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:13.303886 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:13.309253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:13.628080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:13.641752 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-41ba243d-44a5-4937-ad85-39ae72961633 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.381898 Aug 12 10:52:13.646166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 113/258] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:13 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:13.658114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:52:13.658873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:52:13.659529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:52:13.660109 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:52:13.662571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:52:13.681695 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:13.681695 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:13.681695 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:13.682355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:13.687934 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:13.688655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:13.726289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Getting quotas for project ce501b5e17df4518a2ec76763bc3d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:13.734768 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Getting quotas for user 7bd68057dba244cabdb8efe86ee31b7e and project ce501b5e17df4518a2ec76763bc3d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:13.748687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:52:13.751642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:52:13.830516 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-65d5a166-6b23-4c78-8147-50c57f5b649d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813735 Aug 12 10:52:13.831206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 146/259] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:52:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:52:13.847174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a46313e1-e670-4e00-ae57-f3c4c4bbf240 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:13.868015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a46313e1-e670-4e00-ae57-f3c4c4bbf240 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:13.948300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a46313e1-e670-4e00-ae57-f3c4c4bbf240 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:13.956393 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a46313e1-e670-4e00-ae57-f3c4c4bbf240 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1219 microversion: 2.1 time: 0.117404 Aug 12 10:52:13.956963 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 114/260] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:13 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:14.665580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:14.666804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:14.673629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:14.674356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:14.674987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:14.675874 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:14.676529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:14.677161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:14.846534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:14.854985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-75b6d601-3100-4c71-b132-a63e174523ba tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.193360 Aug 12 10:52:14.856105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 147/261] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:14 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:14.977551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:14.979102 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:15.006826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:15.008494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:15.009300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:15.010384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:15.011253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:15.012383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:15.084216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:15.096926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-23650108-98d6-4e55-9e4b-508bac39e208 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1271 microversion: 2.1 time: 0.123151 Aug 12 10:52:15.106339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 115/262] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:14 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:15.879611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:15.880655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:15.890334 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:15.891156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:15.891809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:15.892614 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:15.893146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:15.893632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:16.054233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:16.069003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2102d8e3-582b-4c8c-b1e5-f6852f62e415 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.193213 Aug 12 10:52:16.069575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 148/263] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:15 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:16.120054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:16.120708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:16.130438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:16.130929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:16.131507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:16.132323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:16.133085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:16.133685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:16.253913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:16.263903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e58665ca-4978-4e10-ae1e-5c48aeae85cc tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1279 microversion: 2.1 time: 0.148233 Aug 12 10:52:16.265143 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 116/264] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:16 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1279 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:17.094361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:17.095101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:17.108099 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:17.109225 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:17.109967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:17.112289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:17.114366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:17.114969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:17.286664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:17.287954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:17.298378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:17.298877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:17.299320 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:17.301935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:17.302637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:17.315057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:17.392961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:17.405741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e67fe6ad-97c6-430b-a92e-08356bea6d70 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.315087 Aug 12 10:52:17.407616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 149/265] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:17 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:17.578211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:17.585821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7905d4a0-ed12-4919-9764-5bfb126e97ea tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.303347 Aug 12 10:52:17.586383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 117/266] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:17 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:18.241651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d41efce4-6ba4-48c5-b5a4-0b483ba68026", "tag": "ea909768-a8de-4aa8-88f2-aa7e1e75f295"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:18.251512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.251982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.252426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.264677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] Creating event network-changed:ea909768-a8de-4aa8-88f2-aa7e1e75f295 for instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 on hv-cinder-85294 Aug 12 10:52:18.273540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c6e9ee9f-b9b5-4dfe-b9bf-715e361b8343 req-63e2ff09-663d-43bf-97a2-93dad87632e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035805 Aug 12 10:52:18.274150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 150/267] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:18.434918 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:18.436574 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:18.444765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.446838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.447922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.448898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.449836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.450492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.611330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:18.612473 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:18.624295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.626341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.628027 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.631614 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.632780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.633602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.679857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:18.689407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b040f562-111f-4173-83d4-fdc527fd0092 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1502 microversion: 2.1 time: 0.260533 Aug 12 10:52:18.701524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 118/268] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:18 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1502 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:18.724034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa9a70a9-6171-4b81-8348-d086d492b609"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:18.726793 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:18.733988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.734714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.735464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.736643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.737370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.738124 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.772415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] HTTP exception thrown: Cannot 'attach_volume' instance a2b5d19a-4377-43cc-ae14-942386d69b71 while it is in vm_state rescued Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Request method failure captured: Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/os-volume_attachments HTTP/1.1 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 74 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBxx2qKhRWtVhvGuh4sEchgFVSGUIa--BMtLwuTuBpLIUtlMsFEmoEx5LnJVmgWRKw38eDPWOit2ByMv2oo007-7Kvzos32s8GTLgK16gfwrOC0b2HaUnFROCskJU4hSxBp4fDlrw5Cyn-AvRtWWZAyBPrhRzLv72BYk2wP63FCsN0 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:52:18.776651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc63f648a390465e94ab8170362a9b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}] Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 58e209063f5c454d87d9f743bedfc734 Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {"volumeAttachment": {"volumeId": "aa9a70a9-6171-4b81-8348-d086d492b609"}} Aug 12 10:52:18.778663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Cannot 'attach_volume' instance a2b5d19a-4377-43cc-ae14-942386d69b71 while it is in vm_state rescued Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'server_id': 'a2b5d19a-4377-43cc-ae14-942386d69b71', 'body': {'volumeAttachment': {'volumeId': 'aa9a70a9-6171-4b81-8348-d086d492b609'}}} Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:52:18.779513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a2b5d19a-4377-43cc-ae14-942386d69b71 while it is in vm_state rescued Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:52:18.780840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:52:18.782100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:52:18.782100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:52:18.782100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a2b5d19a-4377-43cc-ae14-942386d69b71 while it is in vm_state rescued Aug 12 10:52:18.782100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:52:18.783107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Returning 409 to user: Cannot 'attach_volume' instance a2b5d19a-4377-43cc-ae14-942386d69b71 while it is in vm_state rescued {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:52:18.784116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-56cc062d-24d2-4da8-9ff4-4107b77a74db tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.071263 Aug 12 10:52:18.785027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 119/269] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:52:18 2022] POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 12 10:52:18.793573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:18.794458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:18.800887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.801616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.802247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.803191 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.803854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.804518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.823582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:18.833747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0c441c41-4cc1-459e-9083-9d6d0da2995a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.230455 Aug 12 10:52:18.835714 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 151/270] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:18 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:18.898538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-178cd769-3659-4f2a-847a-9df1135742f3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/action" status: 202 len: 0 microversion: 2.1 time: 0.107588 Aug 12 10:52:18.902339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 120/271] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:52:18 2022] POST /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:52:18.908910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:18.909851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:18.916108 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.916832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.917413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:18.918785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:18.919616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:18.920597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:19.122206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:19.132092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4b77b458-2a5e-460a-b78b-9ccfa542ae40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.227282 Aug 12 10:52:19.133030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 152/272] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:18 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:19.857410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:19.858121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:19.861391 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:19.881927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:19.882811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:19.883519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:19.884738 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:19.885211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:19.885637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:20.150034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:20.159564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:20.161522 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:20.183180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f3533bca-1a92-46d2-b35a-43b6826e26e2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.330508 Aug 12 10:52:20.190308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 121/273] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:19 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:20.192175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:20.193820 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:20.194593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:20.195553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:20.196677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:20.197714 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:20.228250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:20.470821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:20.478698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2184f926-160d-48e5-85dd-cf93c5e73017 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.326229 Aug 12 10:52:20.480933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 153/274] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:20 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:21.222901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:21.223775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:21.232175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:21.232799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:21.233449 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:21.234312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:21.234929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:21.235675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:21.411945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:21.422318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fbb44297-f840-4845-8068-052462540ff1 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.203851 Aug 12 10:52:21.426621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 122/275] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:21 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:21.505088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:21.506841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:21.514148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:21.514957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:21.515498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:21.516576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:21.517382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:21.518078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:21.681827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:21.697566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-deaa3e98-0907-41ab-9f5d-aec0b19c53e9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.197448 Aug 12 10:52:21.698688 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 154/276] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:21 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:22.454521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:22.456514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:22.469898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.470983 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.471921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.474024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.475254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.476281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.666042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:22.674851 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-93a4ab37-61f8-4252-8afe-9e58dd2163be tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.227787 Aug 12 10:52:22.688296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 123/277] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:22 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:22.711223 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:22.711781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:22.723410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:22.724025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:22.731557 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.732052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.733948 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.734131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.734473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.734852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.735636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.736132 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.736579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.739874 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:22.740600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:22.741028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:22.819349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7217c5ab-4bac-4b7c-b37b-6ec2790b9bc0 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/ips" status: 200 len: 151 microversion: 2.1 time: 0.112486 Aug 12 10:52:22.820553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 155/278] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:52:22 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/ips => generated 151 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:22.983327 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:22.993991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a4513aac-286f-48e3-8d1b-a67e9889a6dd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.274740 Aug 12 10:52:22.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 124/279] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:22 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:23.699199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:23.699812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:23.706158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:23.706636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:23.707056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:23.707744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:23.708190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:23.708647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:23.709063 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:23.746185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=6 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:23.856369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:23.864072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-21184a50-5888-43fc-815c-fd204b510b30 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.168858 Aug 12 10:52:23.864863 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 156/280] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:23 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:24.020523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:24.021390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:24.025110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:24.032109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:24.032629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:24.033070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:24.033766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:24.034221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:24.034670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:24.037277 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:24.172403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:24.180301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cc0d5b62-5093-4704-aacb-de0ec99d0207 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.166915 Aug 12 10:52:24.181534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 125/281] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:24 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:24.886187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:24.886722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:24.888637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:24.893929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:24.894740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:24.895177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:24.895913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:24.896390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:24.896817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.030749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:25.031862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:25.055480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.057435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.059549 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.061581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.062664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.063777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.095693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:25.104724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7ee73a98-c0bf-42c8-b5c2-5b0b6511f0b7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.222332 Aug 12 10:52:25.105398 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 157/282] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:24 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:25.134053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2d6aac80-0ea6-433b-ae1e-049863576a97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/ips" status: 200 len: 153 microversion: 2.20 time: 0.118353 Aug 12 10:52:25.134798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 126/283] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Aug 12 10:52:25 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/ips => generated 153 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:52:25.203849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:25.204626 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:25.212580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.213080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.213505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.214401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.215207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.216233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.398546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "735af54f-8b6e-42a3-95fb-e0163d86509c"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:25.401834 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:25.412221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.413181 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.413873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.414911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:25.415697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:25.416413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:25.434691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:25.454737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f30a633c-0f91-4d0e-b5c0-aa499aa40003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1510 microversion: 2.1 time: 0.256547 Aug 12 10:52:25.455647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 158/284] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:25 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:26.131556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:26.132955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:26.139661 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:26.140220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:26.140703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:26.141593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:26.142247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:26.142890 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:26.286925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:26.298034 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-41a02471-42f3-4ff8-aca5-9a053cd78ed9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.170488 Aug 12 10:52:26.308338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 159/285] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:26 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:26.476195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:26.476775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:26.484587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:26.485351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:26.486409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:26.487606 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:26.488508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:26.489662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:26.695089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-93cc8d62-97b0-49dc-af69-75ae2617bbb2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302080 Aug 12 10:52:26.696624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:26.696875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 127/286] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:52:25 2022] POST /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments => generated 194 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:52:26.707682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-873ac6a4-6722-4b71-a15d-8121266b3ef2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1516 microversion: 2.1 time: 0.236207 Aug 12 10:52:26.720325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 160/287] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:26 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1516 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:27.319681 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:27.320785 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:27.329306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:27.330117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:27.330750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:27.331667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:27.332671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:27.333457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:27.494385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:27.505929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5aa1e6da-4ac2-439a-a5b2-648fb9306587 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.190477 Aug 12 10:52:27.513098 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 128/288] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:27 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:27.724415 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41efce4-6ba4-48c5-b5a4-0b483ba68026", "name": "network-vif-plugged", "status": "completed", "tag": "ea909768-a8de-4aa8-88f2-aa7e1e75f295"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:27.735083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:27.735705 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:27.736198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:27.748624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] Creating event network-vif-plugged:ea909768-a8de-4aa8-88f2-aa7e1e75f295 for instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 on hv-cinder-85294 Aug 12 10:52:27.754289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-1f7b1ff8-9203-4f2f-9891-82516c2731e7 req-9d9ad4f4-6340-42d0-91f9-7df758e52126 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034058 Aug 12 10:52:27.755051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:27.756026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 161/289] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:27.756188 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:27.764231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:27.764875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:27.765231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:27.765997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:27.766641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:27.767075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:27.791860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lazy-loading 'flavor' on Instance uuid 8c63996f-78ad-46b1-8b3b-3fb94a73556a {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:52:28.041692 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-44dc40aa-5d7d-43e6-b81b-b88dd5994c82 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/action" status: 202 len: 0 microversion: 2.20 time: 0.290494 Aug 12 10:52:28.042287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 129/290] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Aug 12 10:52:27 2022] POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:52:28.051508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:28.052764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:28.060052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:28.060887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:28.061372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:28.062868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:28.063483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:28.064147 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:28.224236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-96852cfb-39cf-4a50-b0ea-fb587f0edd40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: .version_select at 0x7efc5cab4940>, body: {"keypair": {"name": "tempest-keypair-435640008", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRiVRJHi7dC2fhNDQLdDGMnjSATvuvrlfwGbTRq0MbVXyQqiBvWOVWQ6IUpQDHJ17JqTV8vzX306AN0KYfYdIU2adopVWtQM0mR339R3svg+AJ00JmLiWjHc2lNyFgaqg=="}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:28.234229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:28.241287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-96852cfb-39cf-4a50-b0ea-fb587f0edd40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for project dc63f648a390465e94ab8170362a9b01. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:28.244824 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-96852cfb-39cf-4a50-b0ea-fb587f0edd40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for user 58e209063f5c454d87d9f743bedfc734 and project dc63f648a390465e94ab8170362a9b01. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:28.245558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:28.247850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:28.249756 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-34feca19-05a6-4a33-a2ed-32016dd3b8ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.202261 Aug 12 10:52:28.268176 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 162/291] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:28 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:28.275774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-96852cfb-39cf-4a50-b0ea-fb587f0edd40 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055758 Aug 12 10:52:28.276659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 130/292] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:52:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:52:28.528900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:28.531382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:28.559911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:28.560923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:28.564227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:28.564227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:28.564227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:28.566086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:28.784182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:28.797835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-24494389-bb51-450d-9af7-b485d248fa7b tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.272609 Aug 12 10:52:28.799717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 163/293] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:28 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:29.277288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:29.278773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:29.292153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:29.293189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:29.293851 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:29.296898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:29.297859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:29.298515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:29.567979 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:29.587721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:29.591053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:29.593283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c689c491-021b-46e6-a85a-e5953f2b5143 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.319069 Aug 12 10:52:29.596649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 131/294] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:29 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:29.820293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:29.821307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:29.829915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:29.830739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:29.831423 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:29.832226 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:29.832906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:29.833540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:30.096817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:30.112725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e2b4903f-6c66-45aa-a431-d350c2b9ff90 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1319 microversion: 2.1 time: 0.295651 Aug 12 10:52:30.115964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 164/295] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:29 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:30.217606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1058362548", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d04db2da-450b-4e62-9b11-b04a9d5232a8"}], "security_groups": [{"name": "tempest-securitygroup--501463114"}], "key_name": "tempest-keypair-435640008", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:30.331982 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] validate_networks() for [('d04db2da-450b-4e62-9b11-b04a9d5232a8', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:52:30.617416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:30.618038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:30.624712 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:30.625203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:30.625640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:30.626374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:30.627037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:30.627706 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:31.002073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:52:31.002667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:52:31.003146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:52:31.003556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:52:31.003981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:52:31.013076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:31.013559 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:31.014235 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:31.014982 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:31.015439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:31.015860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:31.030466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:31.036116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:31.040967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:31.044413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Getting quotas for user 58e209063f5c454d87d9f743bedfc734 and project dc63f648a390465e94ab8170362a9b01. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:31.052826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:31.053451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-64007769-c6f1-4498-b8c7-f883c055b7c4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.440100 Aug 12 10:52:31.054027 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 165/296] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:30 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:31.057145 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:52:31.060360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:52:31.113283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f049decc-202e-4293-b01c-6e74caff2e38 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.900153 Aug 12 10:52:31.114587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 132/297] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:52:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:52:31.125904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-29760337-7848-4d86-8399-495bcf82c3fd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:31.127008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-29760337-7848-4d86-8399-495bcf82c3fd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:31.142434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:31.143250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:31.151678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:31.152192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:31.152661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:31.153660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:31.154116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:31.154538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:31.195194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-29760337-7848-4d86-8399-495bcf82c3fd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:31.202299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-29760337-7848-4d86-8399-495bcf82c3fd tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1245 microversion: 2.1 time: 0.080908 Aug 12 10:52:31.202869 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 166/298] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:31 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:31.355151 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:31.366635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ee02be09-a6d9-4a6d-8870-a198b3188df2 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1508 microversion: 2.1 time: 0.231956 Aug 12 10:52:31.380780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 133/299] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:31 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:32.078339 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:32.079034 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:32.086257 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:32.086764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:32.087177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:32.087970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:32.088370 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:32.088796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:32.224020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:32.224737 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:32.235706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:32.236152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:32.236622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:32.237587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:32.238231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:32.238655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:32.277798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:32.291269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:32.292958 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:32.294154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-80cafcba-3462-414d-b10b-6cb62ccacb19 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.220578 Aug 12 10:52:32.294722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 167/300] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:32 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:32.326157 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:32.335136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-180ffd0a-594e-48e5-a6a1-c5808555cce7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1297 microversion: 2.1 time: 0.116042 Aug 12 10:52:32.336130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 134/301] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:32 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:33.319579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:33.320789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:33.331899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:33.332981 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:33.333596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:33.334527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:33.335115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:33.335666 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:33.359984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:33.360637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:33.375812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:33.376240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:33.378586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:33.380509 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:33.383019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:33.383651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:33.686489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:33.696850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:33.698596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:33.700975 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:33.702231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-40bbd1a1-ad61-4dbf-ab6c-87eeab4d50cc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.387407 Aug 12 10:52:33.703110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 168/302] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:33 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:52:33.724722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3a955620-321e-4892-b4ee-f55ce60503e0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.368398 Aug 12 10:52:33.737187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 135/303] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:33 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:34.498057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:34.511825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:34.512441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:34.513354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:34.531983 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] Creating event network-changed:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:52:34.538461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c92285e0-e90e-48bc-a13d-77581720c189 req-3afffbf5-8c9d-4929-a4b7-36d3dea07410 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045082 Aug 12 10:52:34.539595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 169/304] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:34.730539 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:34.731074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:34.738242 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:34.738728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:34.739376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:34.740100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:34.740672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:34.741152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:34.747986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:34.749071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:34.762522 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:34.763541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:34.764137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:34.765082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:34.765812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:34.766907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:34.996751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:35.009798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:35.015850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:35.020654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-91cf051d-0204-42ff-a793-6e4dd2d146c3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.294097 Aug 12 10:52:35.035194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 136/305] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:34 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:35.045749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:35.055405 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-df3c4561-63a1-4856-bc8c-e344ea27d8eb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.312641 Aug 12 10:52:35.056449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 170/306] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:34 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:35.481976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cf916fdb-b798-4709-ae81-2bf2d3bd3734 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: .version_select at 0x7efc5cab4b80>, body: {"keypair": {"name": "tempest-keypair-1304482335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPRAvFYQovE/7QyOgMvUwG7kmblYmWr7VMrzvnKZKDoD3X51Kxfda1Z74IKW41ohSh1Kh6fUbxmxvX7b+gNdZBV0zCeNMjTfdnjOp8ee8v/+sYUBoN8e+8LEpnHVe4rsA=="}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:35.498634 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf916fdb-b798-4709-ae81-2bf2d3bd3734 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:35.502693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-cf916fdb-b798-4709-ae81-2bf2d3bd3734 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:35.533302 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cf916fdb-b798-4709-ae81-2bf2d3bd3734 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059245 Aug 12 10:52:35.541361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 137/307] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:52:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:36.049689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:36.051095 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:36.059452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.060131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.060648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.061359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.062356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.063144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.079129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:36.079709 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:36.087020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.087713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.088643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.090296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.091109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.091758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.304173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:36.316778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:36.329835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:36.331297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-45ab448f-1cd3-4a8c-aebc-6119d42f4417 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.287669 Aug 12 10:52:36.332155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 171/308] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:36 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:52:36.361405 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-146640812", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:36.421828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:36.430567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c4857fec-cd79-4937-a1d4-1b27eed7ecb2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.356797 Aug 12 10:52:36.431569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 138/309] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:36 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:36.565199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] validate_networks() for None {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:52:36.895266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:52:36.895677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:52:36.896147 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:52:36.896559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:52:36.896962 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:52:36.910835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.911287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.912046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.912491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:36.912937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:36.913364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:36.931505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Getting quotas for project 6b39306332ef498bb63844d1f1a2532b. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:36.935856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Getting quotas for user d9d947f239434197973138d2d7677126 and project 6b39306332ef498bb63844d1f1a2532b. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:36.948217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:52:36.950766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:52:36.999132 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1e5d7192-af9a-4b16-a084-536bae9faef5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641983 Aug 12 10:52:37.007950 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 172/310] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:52:37.018722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d8054910-1a9d-4e51-936c-0a136c038469 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:37.021880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d8054910-1a9d-4e51-936c-0a136c038469 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:37.101860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d8054910-1a9d-4e51-936c-0a136c038469 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:37.109852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d8054910-1a9d-4e51-936c-0a136c038469 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1214 microversion: 2.1 time: 0.100496 Aug 12 10:52:37.111666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 139/311] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:37 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:37.242638 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1161796828", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4619fc67-f793-4a22-b0bd-06a8104796b2"}], "security_groups": [{"name": "tempest-securitygroup--1409119889"}], "key_name": "tempest-keypair-1304482335", "user_data": "}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:37.361184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:37.361829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:37.367997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.368969 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.369445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.370134 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.370591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.371054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.377452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] validate_networks() for [('4619fc67-f793-4a22-b0bd-06a8104796b2', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:52:37.586327 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:37.599260 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:37.601894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:37.603548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d4a0c609-91ca-4fe1-b935-9c5c49b948f7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.247583 Aug 12 10:52:37.604138 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 140/312] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:37 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:52:37.623643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:37.623643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:37.623643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.623643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.624024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.624024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.624024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.624024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.870736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:37.880587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3b2fce37-7352-4bf8-a6eb-cbd3cabc3b61 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.275236 Aug 12 10:52:37.881186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 141/313] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:37 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:37.964280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:52:37.965030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:52:37.965696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:52:37.969462 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:52:37.969902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:52:37.978534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.979193 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.979622 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.980449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:37.981135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:37.981441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:37.988009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:37.999635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:52:38.003783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:52:38.016690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:52:38.019077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:52:38.070301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2d45d7b9-75e2-4c71-9688-2b363aa1b0fd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.832045 Aug 12 10:52:38.071148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 173/314] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:52:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:52:38.084146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-400c8c3d-feb7-485e-b3ff-5ffcaecc589b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:38.085118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-400c8c3d-feb7-485e-b3ff-5ffcaecc589b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:38.135738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:38.136880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:38.148074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.148585 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.149018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:38.149738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.150341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.150936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:38.163629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-400c8c3d-feb7-485e-b3ff-5ffcaecc589b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:38.171156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-400c8c3d-feb7-485e-b3ff-5ffcaecc589b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1242 microversion: 2.1 time: 0.091069 Aug 12 10:52:38.172171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 142/315] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:38 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:38.227540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:38.235634 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-776b70f9-9663-4f7e-b292-3fe8fd89500c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1266 microversion: 2.1 time: 0.106308 Aug 12 10:52:38.236253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 174/316] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:38 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:38.627732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:38.628240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:38.634529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.635012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.635442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:38.636137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.636724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.637147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:38.656072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:38.805638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:38.816792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:38.819261 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:38.820872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e102e73c-c0ca-4f87-82bd-408fd104a017 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.197608 Aug 12 10:52:38.821699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 143/317] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:38 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:38.901651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:38.902447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:38.909560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.910481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.911200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:38.912008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:38.912565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:38.913056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.065769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:39.074365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3b05cd31-e43e-4bc4-80b7-d1ee827843d5 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.176647 Aug 12 10:52:39.084539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 175/318] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:38 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:39.194468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:39.195428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:39.203398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.203865 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.204602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.205577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.206582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.207127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.256574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:39.257489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:39.263896 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.264424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.264860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.265566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.266020 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.266646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.285203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:39.292691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b0fedc61-5b8f-4bda-9387-e0fccebe05e9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1294 microversion: 2.1 time: 0.105057 Aug 12 10:52:39.293972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 144/319] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:39 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:39.337533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:39.351838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-eeb180e2-af77-423d-9563-9cfcff04a8aa tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1272 microversion: 2.1 time: 0.099308 Aug 12 10:52:39.352450 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 176/320] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:39 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:39.846655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:39.847804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:39.852511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "name": "network-vif-plugged", "status": "completed", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:39.855602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.856482 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.857132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.858209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.859281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.860043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.867568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:39.868113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:39.868582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:39.888422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] Creating event network-vif-plugged:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:52:39.895528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-e6077553-a14d-4462-814b-2d1baff4339b req-d4ee34b5-09f5-4fb5-931a-6b062b76377c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049800 Aug 12 10:52:39.896851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 177/321] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:40.039462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.048520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.050386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.051664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4c6bcfb6-437e-4fff-b024-1f0fae924211 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.210778 Aug 12 10:52:40.053007 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 145/322] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:39 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:40.097443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:40.098315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:40.104860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.105527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.106116 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.106725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.107484 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.107906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.314135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:40.314788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:40.316385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.323584 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.323952 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-004d38e7-51e5-45e1-8fe6-8fe4212cc2c2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.231935 Aug 12 10:52:40.324128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.324562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 178/323] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:40 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:40.325949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.326706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.327162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.327585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.373664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:40.374273 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:40.380938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.381644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.382251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.383193 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.383798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.384399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.406079 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.415606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e9a69851-b8e8-45bb-ae71-55966b6e0e92 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1300 microversion: 2.1 time: 0.105381 Aug 12 10:52:40.416961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 146/324] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:40 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1300 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:40.526900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:40.538763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9c12e4bd-6cec-45a7-9656-5ee4b296fc15 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.169511 Aug 12 10:52:40.539357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 179/325] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:40 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:40.896368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b7045f-1192-4790-b3e7-91b5245a664b", "tag": "4491e781-f3fc-4e7c-8165-ef2f22bdffc7"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:40.907401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:40.908168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:40.908989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:40.920210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] Creating event network-changed:4491e781-f3fc-4e7c-8165-ef2f22bdffc7 for instance 47b7045f-1192-4790-b3e7-91b5245a664b on hv-cinder-85294 Aug 12 10:52:40.925152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-ae5c214a-5153-4b5f-bc01-f8793aeffe28 req-bf8a2802-3425-4e89-bc62-387127ef0262 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033388 Aug 12 10:52:40.925747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 147/326] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:41.075534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:41.076173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:41.083329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.083828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.084330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.085224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.085684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.086137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.234118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.243808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.245336 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.246825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0b47f6ce-374d-495b-bd6f-002d19eea789 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.175255 Aug 12 10:52:41.247384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 180/327] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:41 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:41.344052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:41.352721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:41.356317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:41.364932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.366097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.366921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.368038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.368691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.369122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.437627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:41.438370 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:41.444845 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.445409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.446018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.446719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.447173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.447590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.558882 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.567524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6cc7169d-4f9c-4b35-a607-a480fc271a94 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1370 microversion: 2.1 time: 0.225052 Aug 12 10:52:41.568105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 148/328] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:41 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1370 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:41.573182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:41.574500 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:41.587107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.588970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.589848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.590832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:41.591611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:41.592857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:41.620807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.630624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8c589776-6bdf-47a4-b865-5eb5d22e57ad tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.197495 Aug 12 10:52:41.631655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 181/329] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:41 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:41.748962 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:41.756638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-47dd5f7a-6f10-4882-9bd9-b438c70ba45b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.187036 Aug 12 10:52:41.757222 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 149/330] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:41 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:42.270688 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:42.271548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:42.280358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.280851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.281276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.281965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.282410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.282819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.439721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:42.454676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:42.456287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:42.457591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-20610d47-04ed-43c5-82d2-a6b7aa901216 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.191629 Aug 12 10:52:42.458261 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 182/331] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:42 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:42.588933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:42.589562 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:42.596545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.597030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.597462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.598154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.598601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.599019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.654923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:42.655521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:42.661773 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.662265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.662695 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.663609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.664009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.664635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.786835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:42.794647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8c1366e1-c838-4617-a1d9-d68c9645d380 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1564 microversion: 2.1 time: 0.209730 Aug 12 10:52:42.795291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 150/332] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:42 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1564 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:42.800395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:42.801137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:42.803300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:42.809414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.810190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.810957 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.812021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.812602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.813038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.876360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:42.884513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9c8a5bb7-76e1-477c-960c-56a7327d4692 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.233936 Aug 12 10:52:42.895523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 183/333] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:42 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:52:42.895523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:42.895523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:42.898609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.899166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.899670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:42.900558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:42.901084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:42.901596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:43.227689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1033be95-a503-4443-9183-a2ccd1f05697 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.341374 Aug 12 10:52:43.228580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 184/334] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:52:42 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-interface => generated 285 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:43.240498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da711dd0-ec6b-4b9c-ac84-72f961b0950f", "tag": "34f2c281-a84a-48d1-be8a-c806349087ac"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:43.250250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:43.250727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:43.251158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:43.263089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] Creating event network-changed:34f2c281-a84a-48d1-be8a-c806349087ac for instance da711dd0-ec6b-4b9c-ac84-72f961b0950f on hv-cinder-85294 Aug 12 10:52:43.268036 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-a7d8810d-fa06-48e9-9065-38e2119bc2fa req-12446352-f22b-40b0-85ee-204e4340f6a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031262 Aug 12 10:52:43.268640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 185/335] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:43.346004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:43.358565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-95c41c37-0067-4eef-9e9a-57319d510d05 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.561929 Aug 12 10:52:43.359624 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 151/336] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:42 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:43.482154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:43.482818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:43.489640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:43.490410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:43.491047 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:43.492014 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:43.492724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:43.493210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:43.753868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:43.762913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:43.764696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:43.766087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3595d627-023d-4ee5-8bd8-f48c90f0d059 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.288212 Aug 12 10:52:43.781523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 186/337] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:43 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:43.906577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:43.909185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:43.915648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:43.916394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:43.916829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:43.917703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:43.918513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:43.919421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.158546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:44.166590 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cdf9c93c-c64d-45b8-ba79-619392c6446a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.264587 Aug 12 10:52:44.167058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 152/338] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:43 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:44.379518 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:44.380243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:44.386874 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:44.387897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:44.388565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.389371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:44.389849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:44.391666 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.448126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:44.458626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:44.459209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:44.459640 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.471684 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] Creating event network-changed:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:52:44.477827 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d6104cb8-3ed3-4bb7-bf88-54293d4a6d06 req-be9954fa-ab44-44c6-ae36-58e57d0e5427 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033960 Aug 12 10:52:44.478741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 153/339] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:52:44.544075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:44.555119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-da8acaeb-1013-4168-9e47-f039946c3223 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.179443 Aug 12 10:52:44.556051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 187/340] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:44 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:44.790256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:44.791571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:44.803027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:44.803521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:44.803928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.804906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:44.805322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:44.805779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:44.962632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:44.975291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:44.976733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:44.977907 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-258c8969-cab4-430e-aba9-11e490ac0eb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.192114 Aug 12 10:52:44.978572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 154/341] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:44 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:45.187726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:45.188430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:45.195126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:45.195620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:45.196054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:45.196806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:45.197265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:45.197686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:45.337664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:45.346691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-78cf28e9-af78-4fd0-93ca-b8bea71ed21e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.163335 Aug 12 10:52:45.347284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 188/342] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:45 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:45.577690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:45.578381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:45.584681 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:45.585180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:45.585619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:45.586322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:45.586779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:45.587441 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:45.730721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:45.738554 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-252d3f28-3fb4-420b-b260-e053af0a0e3c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.164680 Aug 12 10:52:45.738915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 155/343] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:45 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:46.001422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:46.002127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:46.008469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.008921 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.009362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.010044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.010512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.010969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.155163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:46.163595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:46.165224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:46.166390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-91c469e3-1ed6-4050-af29-bac73db60d7c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.168980 Aug 12 10:52:46.166957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 189/344] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:45 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:46.367366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:46.367896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:46.375233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.375722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.376164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.376883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.377411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.377829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.524006 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:46.532598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c71e9ef1-1403-46c0-a57b-ea5296febfcd tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.169370 Aug 12 10:52:46.533167 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 156/345] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:46 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:46.759984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:46.760626 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:46.767829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.768541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.769095 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.770416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:46.771040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:46.771591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:46.912827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:46.922507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ae47fa76-f5cd-4fe3-bf56-7452daa9302f tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.166371 Aug 12 10:52:46.922955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 190/346] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:46 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:47.189795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:47.190483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:47.196729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.197219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.197656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:47.198356 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.198815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.199993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:47.335876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:47.345748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:47.347253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:47.348442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e52ba150-f71b-40b3-9af8-e6ea12bb5e55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.162542 Aug 12 10:52:47.348999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 157/347] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:47 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:47.553321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:47.553885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:47.555867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:47.562033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.562573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.563001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:47.563694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.564138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.564580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:47.708198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:47.715815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-87f9b3e5-d8bf-477e-8a2c-11b197a47282 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.166317 Aug 12 10:52:47.716478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 191/348] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:47 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:47.944832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:47.945337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:47.953083 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.953598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.954037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:47.954767 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:47.955223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:47.955649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:48.106753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:48.116061 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-10a056d0-0fc5-4262-be8e-f2ff74c4a89c tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.175165 Aug 12 10:52:48.116667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 158/349] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:47 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:48.371482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:48.372100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:48.374541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=4 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:48.375227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=14 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:48.381572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:48.382073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:48.382501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:48.383188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:48.383632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:48.384051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:48.388901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:48.526511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:48.535067 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:48.536615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:48.537783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b38456ba-e25e-44a3-926d-e5637d84a854 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.170245 Aug 12 10:52:48.538333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 192/350] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:48 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:48.739598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:48.740430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:48.743271 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=18 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:48.750370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:48.750777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:48.751207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:48.751889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:48.752361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:48.752777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:48.899796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:48.907831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f7b1f992-166c-4371-b504-1a8b41d3c1ea tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.174591 Aug 12 10:52:48.908502 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 159/351] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:48 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:49.137621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:49.138654 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:49.148876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.149375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.149965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:49.150734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.151180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.151594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:49.294551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:49.302466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7c75e296-2b85-4f86-b06c-09901a78d616 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.168880 Aug 12 10:52:49.302963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 193/352] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:49 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:49.562689 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:49.563297 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:49.570316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.570794 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.571253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:49.571945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.572442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.572872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:49.718189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:49.726229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:49.727718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:49.728911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6697aa90-1780-4156-91ee-5df8a228d180 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.170456 Aug 12 10:52:49.729660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 160/353] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:49 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:49.929506 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:49.930143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:49.938367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.938367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.938367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:49.938367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:49.938956 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:49.938956 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:50.217740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:50.225193 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8ee739fd-b3b8-4cdf-9706-a05c89c67032 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.299766 Aug 12 10:52:50.225759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 194/354] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:49 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:50.323781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:50.324504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:50.331220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:50.331736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:50.332228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:50.332961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:50.333420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:50.333822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:50.349187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=100 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:50.464251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:50.472006 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d0cba6c0-c1ea-4359-ac04-9d7aa9a03220 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.152292 Aug 12 10:52:50.472812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 161/355] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:50 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:50.760866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:50.762040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:50.769045 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:50.769522 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:50.770280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:50.770962 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:50.771404 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:50.771824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:50.920001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:50.929296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:50.932755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:50.933973 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-64f833b3-a7b4-45bc-96b9-92b9d9904d6f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1746 microversion: 2.20 time: 0.182680 Aug 12 10:52:50.934743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 195/356] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:50 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1746 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:51.246607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:51.247410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:51.256480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.256965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.257423 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:51.258120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.258589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.258988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:51.392230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:51.400364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fd47a522-6c93-45f9-acb8-332b98fa0568 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.158385 Aug 12 10:52:51.400932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 162/357] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:51 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:51.500684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:51.501282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:51.507818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.508430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.508900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:51.509644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.510089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.510509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:51.663942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:51.673411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8951f83f-32c5-4060-9570-4c28a54adb38 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.176559 Aug 12 10:52:51.673965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 196/358] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:51 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:51.957445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:51.958098 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:51.965588 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.966058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.966660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:51.967453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:51.967910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:51.968363 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:52.103809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:52.113276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:52.114829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:52.116017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0785332e-55c0-4a47-92af-310440d4bafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1746 microversion: 2.20 time: 0.162561 Aug 12 10:52:52.116588 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 163/359] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:51 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:52.422325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:52.423010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:52.429619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:52.430082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:52.430501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:52.431198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:52.431651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:52.432075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:52.569677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:52.579783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b005af1e-556c-41cd-aec0-34a9ff6c1748 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.161490 Aug 12 10:52:52.580393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 197/360] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:52 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:52.694993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:52.695556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:52.703413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:52.704195 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:52.704746 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:52.705599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:52.706148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:52.706585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:52.852061 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:52.861991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-44e9424c-9dfe-4b84-93f0-1e19c01ff849 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.170946 Aug 12 10:52:52.862560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 164/361] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:52 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:53.141374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:53.141893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:53.148570 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.149058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.149533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.150317 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.150768 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.151191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.297769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:53.306263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:53.307795 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:53.309131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-82fde0af-524e-41b1-8180-531e73f2a90a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1746 microversion: 2.20 time: 0.171778 Aug 12 10:52:53.312843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 198/362] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:53 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1746 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:53.366355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d52a669-cf37-46bf-beab-5eb2d2883aba", "device": "/dev/sdb"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:53.369365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:53.375758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.376247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.376707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.377400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.377835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.378256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.602761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:53.603498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:53.613018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.613833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.614296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.615624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.616442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.617086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.710451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-15653ca9-5292-4716-9df2-8e868908615f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "POST /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348126 Aug 12 10:52:53.711689 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 165/363] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:52:53 2022] POST /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026/os-volume_attachments => generated 194 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:53.757658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b7045f-1192-4790-b3e7-91b5245a664b", "name": "network-vif-plugged", "status": "completed", "tag": "4491e781-f3fc-4e7c-8165-ef2f22bdffc7"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:53.768105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.768820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.769171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.790382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] Creating event network-vif-plugged:4491e781-f3fc-4e7c-8165-ef2f22bdffc7 for instance 47b7045f-1192-4790-b3e7-91b5245a664b on hv-cinder-85294 Aug 12 10:52:53.790827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:53.797304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-27461497-aa03-4917-8ee2-e2b04402cdb7 req-7968429f-beb1-4f98-a461-7f1160e05d94 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043316 Aug 12 10:52:53.798218 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 166/364] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:52:53.804736 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e26b8443-b4fb-4564-b2bd-910f80ec844e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.204211 Aug 12 10:52:53.812765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 199/365] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:53 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:53.886414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:53.887139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:53.900241 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.900770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.901207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:53.901918 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:53.902365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:53.902791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:54.055106 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:54.067198 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e8ecf099-ea38-4dd8-9edb-b1e3b65fdad0 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.185496 Aug 12 10:52:54.067782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 167/366] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:53 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:54.334798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:54.335537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:54.343555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:54.344040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:54.344514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:54.345213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:54.345663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:54.346055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:54.482243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:54.490244 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:54.491734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:54.492880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-743dc6d1-2118-42ed-9768-d4c2e80baeeb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1746 microversion: 2.20 time: 0.164493 Aug 12 10:52:54.493455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 200/367] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:54 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:54.829930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:54.830506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:54.837394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:54.837860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:54.838291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:54.838964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:54.839542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:54.839972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:54.974089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:54.985486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c4da782a-79bf-405d-9047-51dd4eb97884 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.159780 Aug 12 10:52:54.986243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 168/368] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:54 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:55.092612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:55.093162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:55.099738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:55.100224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:55.100687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:55.101386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:55.101839 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:55.102249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:55.248472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:55.256421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-89cbf512-fece-4966-9def-9d5073a0a87b tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.168102 Aug 12 10:52:55.256950 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 201/369] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:55 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:55.517858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:55.518384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:55.525290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:55.525805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:55.526244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:55.526944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:55.527511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:55.527881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:55.665040 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:55.673427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:55.674989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:55.676114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5fbfe3e2-5130-43a0-8624-1d092fffa6ca tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1746 microversion: 2.20 time: 0.163036 Aug 12 10:52:55.676757 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 169/370] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:55 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:55.820471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da711dd0-ec6b-4b9c-ac84-72f961b0950f", "name": "network-vif-plugged", "status": "completed", "tag": "34f2c281-a84a-48d1-be8a-c806349087ac"}, {"server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "name": "network-vif-plugged", "status": "completed", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:52:55.831658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:55.832134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:55.832605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:55.845895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Creating event network-vif-plugged:34f2c281-a84a-48d1-be8a-c806349087ac for instance da711dd0-ec6b-4b9c-ac84-72f961b0950f on hv-cinder-85294 Aug 12 10:52:55.846389 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] Creating event network-vif-plugged:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:52:55.853258 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-63411c26-b98a-418e-928c-b03c8f45b6d1 req-dd7bb2aa-0b16-4c20-912d-15b8906ff014 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036525 Aug 12 10:52:55.853816 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 202/371] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:52:56.017543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:56.018742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:56.029291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.030609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.031054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.031755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.032206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.032659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.168768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:56.180981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7c9c730d-2cb4-4680-ba65-6cf99c8313cb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.170617 Aug 12 10:52:56.181553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 170/372] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:56 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:56.279582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:56.280393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:56.286965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.287444 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.287867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.288564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.288987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.289425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.432184 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:56.443741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a20c6d8b-3892-489b-91f3-094bad8179ea tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1314 microversion: 2.1 time: 0.168126 Aug 12 10:52:56.444414 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 203/373] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:56 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:56.699605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:56.700560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:56.708352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.708856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.709331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.710247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:56.710705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:56.711131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:56.852421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:56.862139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:56.863620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:56.864811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-40532693-0f17-45d9-ac9b-86cb82ea8575 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.169200 Aug 12 10:52:56.865367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 171/374] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:56 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:57.203990 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:57.204610 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:57.215445 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.216229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.216780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.218745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.219251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.219693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.384619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:57.393894 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-04f3c0d7-2605-45ce-b3ca-1d85239e83e2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.194313 Aug 12 10:52:57.395077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 204/375] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:57 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:57.465217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:57.465876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:57.473181 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.473671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.474106 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.474832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.475289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.475712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.613999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:57.621758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2fb010bf-75ea-4e45-9273-cb273c21d6d5 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1464 microversion: 2.1 time: 0.160456 Aug 12 10:52:57.622327 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 172/376] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:57 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:57.672131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:57.672650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:57.679223 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.679727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.680187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.680913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.681368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.681820 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.707447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:52:57.820970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-80bb4fd8-420e-4a36-908f-afc5bb0f2404 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "DELETE /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 204 len: 0 microversion: 2.1 time: 0.152318 Aug 12 10:52:57.821781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 205/377] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:52:57 2022] DELETE /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:52:57.830409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:57.831025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:57.838803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.839544 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.840188 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.840927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.841530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.842094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.889972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:57.890790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:57.897956 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.898898 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.899520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:57.900469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:57.901016 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:57.901530 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:58.043043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:58.055283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6c8c7268-8dc2-4c7f-8feb-70819bb6def4 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.229246 Aug 12 10:52:58.055849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 173/378] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:57 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:58.096040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:58.104907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:58.106508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:58.107849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a5056505-8f1b-4a0d-97c2-2317bc08fec4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.222672 Aug 12 10:52:58.110596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 206/379] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:57 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:58.414984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:58.415995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:58.422637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:58.423253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:58.423753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:58.424816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:58.425111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:58.425893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:58.579163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:58.594166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-668a120a-d3a8-47fc-b8a3-40b61b335055 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.182620 Aug 12 10:52:58.595503 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 174/380] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:58 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:59.077951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:59.078581 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:59.085221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.085711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.086140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.089826 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.090311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.090843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.140479 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:59.141754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:59.157360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.157989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.158452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.160493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.163358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.163842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.650181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:59.654399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:52:59.661326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b2e41838-367b-46fb-b4dd-71fc11492beb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.587836 Aug 12 10:52:59.669175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:59.678685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:59.680088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 207/381] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:59 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:52:59.684892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:59.686644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fc7879ae-294f-4598-9eef-2edee8525bdf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.552278 Aug 12 10:52:59.696669 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 175/382] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:52:59 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:52:59.702452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:52:59.703404 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:52:59.710449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.711377 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.711992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.713416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:52:59.713925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:52:59.714325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:52:59.862524 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:52:59.870271 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1f5f7916-217f-4710-afca-697f0c484bd3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1368 microversion: 2.1 time: 0.188905 Aug 12 10:52:59.871500 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 208/383] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:52:59 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:00.703397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:00.709356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:00.710106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:00.713126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:00.721611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.723508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.724200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.725170 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.725619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.726343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.726808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.727238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.731637 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.732502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.733248 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.733802 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.941830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:00.943288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:00.951189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b95d8ca4-9bea-4f76-9a55-8882fb8c3629 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.251840 Aug 12 10:53:00.958421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:00.965484 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 176/384] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:00 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:00.970505 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:00.971307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:00.977652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.978354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.979140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.980107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:00.980284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:00.980929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:00.981540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:00.984844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-11321326-f61b-4fb2-b0bd-d5ca8b133642 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.276608 Aug 12 10:53:00.985652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 209/385] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:00 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:00.998057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:01.151059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:01.159877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-33f31f20-1d4a-4304-9416-51bd37c8f212 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1558 microversion: 2.1 time: 0.193096 Aug 12 10:53:01.160563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 177/386] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:00 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:01.184106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:01.185007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:01.193026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:01.193810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:01.194463 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:01.195392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:01.196156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:01.196613 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:01.288478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3a70862c-f675-4919-a388-39dde4c9f372 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107723 Aug 12 10:53:01.297753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 210/387] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:53:01 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:01.977799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:01.979224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:01.993278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:01.993774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:01.994246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:02.000205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:02.001196 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:02.001791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:02.011314 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:02.013128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:02.027239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:02.028207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:02.031028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:02.032103 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:02.033013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:02.035679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:02.252614 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:02.261740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-edb81643-8ac6-4bca-bdf4-6a7f173aeefb tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.292995 Aug 12 10:53:02.277901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 178/388] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:01 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:02.302008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:02.316968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:02.319952 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:02.324104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-af1cf2e6-c3bf-4ce6-b797-c75b9fbe6562 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.315344 Aug 12 10:53:02.326085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 211/389] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:02 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:02.678113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da711dd0-ec6b-4b9c-ac84-72f961b0950f", "tag": "34f2c281-a84a-48d1-be8a-c806349087ac"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:02.686958 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:02.687498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:02.687868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:02.710766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] Creating event network-changed:34f2c281-a84a-48d1-be8a-c806349087ac for instance da711dd0-ec6b-4b9c-ac84-72f961b0950f on hv-cinder-85294 Aug 12 10:53:02.710766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-72dcda32-03c6-4665-880a-dd825866ab89 req-db7027c7-b98a-459e-a0fc-3554e474d978 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040688 Aug 12 10:53:02.710766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 179/390] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:03.286374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:03.287786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:03.294691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:03.295652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:03.300128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:03.301219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:03.301840 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:03.302542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:03.353955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:03.354659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:03.372988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:03.375870 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:03.376573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:03.377337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:03.377877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:03.377993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:03.663573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:03.679451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-52456646-564c-4de3-beb8-2db31848c856 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.398891 Aug 12 10:53:03.681149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 212/391] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:03 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:03.711459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:03.722729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:03.727467 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:03.728957 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9f3f09ee-d69a-496c-a040-6c1e83ec8f60 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.380065 Aug 12 10:53:03.729811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 180/392] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:03 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:04.683185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b7045f-1192-4790-b3e7-91b5245a664b", "name": "network-vif-unplugged", "status": "completed", "tag": "4491e781-f3fc-4e7c-8165-ef2f22bdffc7"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:04.698978 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:04.699831 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:04.700583 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:04.704023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:04.704675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:04.712941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:04.713673 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:04.714266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:04.715132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:04.716764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:04.717655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:04.722588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] Creating event network-vif-unplugged:4491e781-f3fc-4e7c-8165-ef2f22bdffc7 for instance 47b7045f-1192-4790-b3e7-91b5245a664b on hv-cinder-85294 Aug 12 10:53:04.733578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-672acfe2-3be3-4c5a-b3b5-9448cf012313 req-cde3d7ea-cf53-4a04-a413-cce9cdd9de12 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054219 Aug 12 10:53:04.734504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 213/393] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:04.751618 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:04.752455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:04.760305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:04.761109 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:04.761747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:04.762851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:04.763497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:04.764120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:04.920935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:04.930703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0729f9a2-234d-41f2-88db-9afeba12a8b3 tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1470 microversion: 2.1 time: 0.231041 Aug 12 10:53:04.931429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 181/394] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:04 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1470 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:04.971503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:04.988718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:04.990995 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:04.992450 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-843eb265-6694-4174-951b-43a3a6728426 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.245178 Aug 12 10:53:04.993412 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 214/395] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:04 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:05.597986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b7045f-1192-4790-b3e7-91b5245a664b", "name": "network-vif-deleted", "tag": "4491e781-f3fc-4e7c-8165-ef2f22bdffc7"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:05.630344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:05.630826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:05.631253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:05.655337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] Creating event network-vif-deleted:4491e781-f3fc-4e7c-8165-ef2f22bdffc7 for instance 47b7045f-1192-4790-b3e7-91b5245a664b on hv-cinder-85294 Aug 12 10:53:05.661380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-1e5b4d8f-87df-418d-bd86-587726d162ad req-0b3ede04-7dd2-4ef6-b07e-8effcfdbfbc1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074126 Aug 12 10:53:05.662112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 182/396] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:05.953406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:05.954158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:05.968602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:05.969474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:05.970131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:05.971085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:05.971746 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:05.972607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:06.009284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:06.010194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:06.010838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:06.011496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lazy-loading 'fault' on Instance uuid 47b7045f-1192-4790-b3e7-91b5245a664b {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:53:06.017164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:06.017897 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:06.025662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:06.026811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:06.027420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:06.028392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:06.029062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:06.029680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:06.067331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9d947f239434197973138d2d7677126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b39306332ef498bb63844d1f1a2532b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:06.075311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3f5c9dea-e029-4bea-8c10-88eb7e5f1cdf tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 200 len: 1304 microversion: 2.1 time: 0.126838 Aug 12 10:53:06.088285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 215/397] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:05 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:06.201188 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:06.211597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:06.213408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:06.214580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-95deab1f-85f6-443d-90ca-206f981ea36f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1741 microversion: 2.20 time: 0.203200 Aug 12 10:53:06.215132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 183/398] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:06 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:07.102474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:07.103072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] [instance: 47b7045f-1192-4790-b3e7-91b5245a664b] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:07.109293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:07.109806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:07.110242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:07.110970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:07.111426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:07.111838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:07.126379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] HTTP exception thrown: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Request method failure captured: Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b HTTP/1.1 Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jDy9JyGdKK_K-zKqqPKiy13hc1lEQLPL77-JfqFg2hzyJX-K0X_ClWhNdaC_Nl3Me4wp2DgQhO9nAjUkeRj7aOitmhK5Y5ZiXNM-bP95Z7TOB_303zTwbZUDW3sO0S-54E4_DUhgRW0lEphQyDnoDC7OLoZUpESjxOFikuQLC3y5jU Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 6b39306332ef498bb63844d1f1a2532b Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesNegativeTest-650959053 Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:53:07.128350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/6b39306332ef498bb63844d1f1a2532b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6b39306332ef498bb63844d1f1a2532b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_6b39306332ef498bb63844d1f1a2532b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/6b39306332ef498bb63844d1f1a2532b"}]}] Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesNegativeTest-650959053 Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 6b39306332ef498bb63844d1f1a2532b Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesNegativeTest-650959053 Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesNegativeTest-650959053-project Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: d9d947f239434197973138d2d7677126 Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesNegativeTest-650959053-project Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. Aug 12 10:53:07.129935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '47b7045f-1192-4790-b3e7-91b5245a664b'} Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:53:07.130829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. Aug 12 10:53:07.132496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:07.141932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] Returning 404 to user: Instance 47b7045f-1192-4790-b3e7-91b5245a664b could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:53:07.141932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-21a5b20b-cbba-410c-9ee4-d5bfd80a4f9a tempest-VolumesNegativeTest-650959053 tempest-VolumesNegativeTest-650959053-project] 10.222.0.23 "GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b" status: 404 len: 111 microversion: 2.1 time: 0.031325 Aug 12 10:53:07.141932 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 216/399] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:07 2022] GET /compute/v2.1/servers/47b7045f-1192-4790-b3e7-91b5245a664b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:53:07.237941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:07.239146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:07.246330 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:07.246820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:07.247235 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:07.248023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:07.248831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:07.249826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:07.389480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:07.400605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:07.402081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:07.403247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-461defe8-2197-4bb5-9740-3ee70e93a91f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.169436 Aug 12 10:53:07.403979 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 184/400] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:07 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:08.427470 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:08.428651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:08.436217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:08.436744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:08.437141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:08.438111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:08.438760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:08.439335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:08.579804 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:08.588307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:08.589758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:08.590920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-270bf80c-e80b-4624-b2d4-e929127d4b32 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.167645 Aug 12 10:53:08.591467 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 217/401] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:08 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:09.614182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:09.614798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:09.621420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:09.621984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:09.622450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:09.623223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:09.623741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:09.624225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:09.759048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:09.767859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:09.769383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:09.770891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3e72f5d8-b108-4001-9638-155d108a9d61 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.160717 Aug 12 10:53:09.771462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 185/402] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:09 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:10.551210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "name": "network-vif-unplugged", "status": "completed", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:10.561267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:10.561742 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:10.562209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:10.573967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] Creating event network-vif-unplugged:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:53:10.579319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-9992a78e-65d8-4835-aa8a-38c92f3e608f req-3694ceb9-30a2-45af-9037-f9d68a6f7a5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031780 Aug 12 10:53:10.579929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 218/403] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:53:10.794721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:10.795253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:10.802148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:10.802633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:10.803093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:10.803786 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:10.804243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:10.804699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:10.950382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:10.961923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:10.963443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:10.964680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3d9c2015-381d-459a-bb5e-24801613c8d8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.174028 Aug 12 10:53:10.965237 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 186/404] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:10 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:11.987743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:11.988459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:11.994953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:11.995436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:11.995872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:11.996671 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:11.997131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:11.997555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:12.132857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:12.143550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:12.145401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:12.146547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e28ad154-369a-4711-b8fe-d0013567d1a8 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.163167 Aug 12 10:53:12.147144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 219/405] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:11 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:13.169704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:13.170341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:13.173043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=72 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:13.178530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:13.179017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:13.179451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:13.180142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:13.180697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:13.181132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:13.322888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:13.335980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:13.338515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:13.340438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ad46d9a7-ede1-425e-acfa-953d40541d49 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1723 microversion: 2.20 time: 0.174435 Aug 12 10:53:13.341179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 187/406] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:13 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:14.364560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:14.365200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:14.371880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:14.372453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:14.372852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:14.373543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:14.374620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:14.375074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:14.509899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:14.518699 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:14.520603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:14.521757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1b470ac8-e626-4285-9e71-8255c255bbe2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1726 microversion: 2.20 time: 0.161186 Aug 12 10:53:14.522319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 220/407] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:14 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:14.544335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff140c3f-f53a-4313-b235-cd0f40773019"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:14.546675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:14.553567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:14.554057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:14.554494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:14.555185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:14.555704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:14.556136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:14.847187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-06d9f934-a373-4c8f-877a-fac6fbe2d3e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306972 Aug 12 10:53:14.847827 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 188/408] 10.222.0.23 () {62 vars in 1364 bytes} [Fri Aug 12 10:53:14 2022] POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:53:14.997846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:14.998544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:15.007739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:15.008373 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:15.008870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:15.009865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:15.010425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:15.010969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:15.056576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132240) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 10:53:15.131174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9dd14c0d-f0c1-4164-ae63-5789cf469102 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/action" status: 202 len: 0 microversion: 2.20 time: 0.139435 Aug 12 10:53:15.135449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 221/409] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Aug 12 10:53:14 2022] POST /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:53:15.141968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:15.142901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:15.150260 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:15.150872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:15.151411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:15.152155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:15.152641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:15.153045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:15.290342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:15.299140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:15.300731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:15.301808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6619581e-2d0a-4e6a-aaaf-fd532b46ce22 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1812 microversion: 2.20 time: 0.164156 Aug 12 10:53:15.302395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 189/410] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:15 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:16.328915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:16.329874 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:16.340224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:16.341062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:16.341784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:16.343010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:16.343486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:16.343904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:16.492814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:16.501708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:16.503191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:16.504356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1fe94d7e-afd3-4083-80b3-eb49dc1f58cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1812 microversion: 2.20 time: 0.182058 Aug 12 10:53:16.504870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 222/411] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:16 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1812 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:17.527021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:17.527528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:17.534287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:17.534778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:17.535216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:17.535925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:17.536400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:17.536819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:17.687598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:17.697930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:17.705193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:17.705193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8e330f81-dd8f-42c4-9451-c1095f7d97dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1754 microversion: 2.20 time: 0.177634 Aug 12 10:53:17.713054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 190/412] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:17 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:18.723739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:18.725052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:18.727197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:18.733058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:18.733766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:18.734076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:18.734772 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:18.735505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:18.735810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:18.884555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:18.894275 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:18.896092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:18.897328 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d458e668-579c-4a25-98f8-c450e44f4f26 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1754 microversion: 2.20 time: 0.177396 Aug 12 10:53:18.898255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 223/413] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:18 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:19.920018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:19.920890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:19.928250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:19.928907 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:19.929542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:19.930474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:19.931140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:19.931858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:20.079073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:20.087566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:20.089165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:20.090344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-40887d70-e228-4cc4-ab65-1aacd827e615 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1754 microversion: 2.20 time: 0.174291 Aug 12 10:53:20.090911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 191/414] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:19 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:21.115935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:21.117181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:21.123392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:21.123910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:21.124357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:21.125056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:21.125501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:21.125920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:21.413971 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:21.423424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:21.424965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:21.426418 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3c97ef95-235e-498b-ad49-dc33939bc8e0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1754 microversion: 2.20 time: 0.314361 Aug 12 10:53:21.426946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 224/415] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:21 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1754 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:22.453615 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:22.454240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:22.481120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:22.481985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:22.483017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:22.485311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:22.487154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:22.489404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:22.691819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:22.701463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:22.731066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:22.733813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:22.735886 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-911ef03a-d1ee-4de1-9227-17471f2a9f78 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1754 microversion: 2.20 time: 0.288323 Aug 12 10:53:22.750643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 192/416] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:22 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1754 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:23.767330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:23.768600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:23.777038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:23.777848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:23.778468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:23.779507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:23.780254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:23.780877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:23.801009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:23.950511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:23.966503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:23.968822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:23.970182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-17877c68-27ce-4847-bc69-903ca7abccb9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.208823 Aug 12 10:53:23.970835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 225/417] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:23 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:24.994063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:24.994658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:25.004652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:25.005436 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:25.006096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:25.006915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:25.007595 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:25.007990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:25.154975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:25.165496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:25.167390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:25.168602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7f17863f-16c7-41fa-8f0b-e9a3d84e21bf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.178970 Aug 12 10:53:25.180118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 193/418] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:24 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:25.262101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:25.264463 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:25.271731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:25.272316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:25.272994 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:25.273923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:25.274612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:25.275280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:25.436426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lazy-loading 'services' on Instance uuid d41efce4-6ba4-48c5-b5a4-0b483ba68026 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:53:25.639123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7617e27d-ebc0-46f1-b724-108b3bc347fe tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026/os-volume_attachments/4d52a669-cf37-46bf-beab-5eb2d2883aba" status: 202 len: 0 microversion: 2.1 time: 0.380748 Aug 12 10:53:25.640439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 226/419] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:53:25 2022] DELETE /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026/os-volume_attachments/4d52a669-cf37-46bf-beab-5eb2d2883aba => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:53:26.193022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:26.194453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:26.206638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:26.211798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:26.212444 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:26.213290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:26.213855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:26.214378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:26.518885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:26.536477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:26.539616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:26.544160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e25d71a4-7f21-4002-9e33-55a56f677a4e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.356472 Aug 12 10:53:26.546240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 194/420] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:26 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:27.571563 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:27.572372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:27.588764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:27.589452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:27.589940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:27.590664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:27.591108 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:27.591700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:28.009106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:28.054913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:28.062579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:28.065650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1fc3ba5e-9073-45c1-a851-281014fa69cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.499711 Aug 12 10:53:28.080335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 227/421] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:27 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:29.095333 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:29.096603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:29.110316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:29.116602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:29.119924 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:29.125989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:29.126510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:29.130744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:29.427288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:29.449259 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:29.481647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:29.497600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bd8c99d0-53d4-41f5-a6c4-0b8c201be7e1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.396298 Aug 12 10:53:29.499835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 195/422] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:29 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:30.523270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:30.524537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:30.539084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:30.540523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:30.541159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:30.544141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:30.545268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:30.546713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:30.908562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:30.936227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:30.940421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:30.944776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0ec3df58-d9e0-4ecb-8d67-074054526a51 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.425403 Aug 12 10:53:30.961161 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 228/423] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:30 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:31.971021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:31.978849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:31.999968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:32.001870 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:32.002858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:32.005550 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:32.006670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:32.008111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:32.237697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:32.252650 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:32.254422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:32.259950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-83c4eed3-d079-4e2e-b236-04379ab36f30 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.292902 Aug 12 10:53:32.273830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 196/424] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:31 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:33.287385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:33.288879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:33.297399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:33.298267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:33.299111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:33.300070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:33.300718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:33.301369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:33.568523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:33.579659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:33.587207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:33.591879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8db2da6f-ef3e-4dec-92e7-f8c3c4d5f30b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.306944 Aug 12 10:53:33.593156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 229/425] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:33 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:34.617780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:34.618507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:34.628434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:34.631658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:34.634498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:34.635602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:34.640655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:34.642238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:35.004119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:35.015952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:35.018854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:35.020814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cc1e64c3-b7a1-484d-82dc-69142b48a483 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.407300 Aug 12 10:53:35.032349 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 197/426] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:34 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:35.960834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:35.962002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:35.981170 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:35.981789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:35.984244 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:35.985515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:35.988304 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:35.990945 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:36.053117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:36.053727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:36.066967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:53:36.068733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:36.069424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:36.072483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:36.077167 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:36.077717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:36.078190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:36.372452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5b726d25-5c03-4296-96f8-52619655e415 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 204 len: 0 microversion: 2.1 time: 0.409641 Aug 12 10:53:36.374381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 230/427] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:53:35 2022] DELETE /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:53:36.396110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:36.410253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:36.411024 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:36.415796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:36.418073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:36.420871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:36.421613 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:36.422210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:36.423066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7a621394-a992-43a0-9dd1-d21d9f5b2664 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.378741 Aug 12 10:53:36.423207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:36.423780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:36.424373 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:36.427139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 198/428] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:36 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:36.628369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:36.641724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-06fae54f-669a-43b5-870c-b0640581bda7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1514 microversion: 2.1 time: 0.259249 Aug 12 10:53:36.653089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 231/429] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:36 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:37.449305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:37.450037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:37.463915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:37.466829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:37.467561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:37.470755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:37.471346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:37.471871 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:37.667801 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:37.668572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:37.685757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:37.686461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:37.687147 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:37.688490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:37.689026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:37.690143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:37.731680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:37.746618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:37.755044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:37.756695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b3c62808-977f-4ae2-a054-25df7dd52b59 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.313022 Aug 12 10:53:37.757809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 199/430] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:37 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:37.888086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:37.898321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fa30738a-66fc-4af8-9187-945406809ca7 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1514 microversion: 2.1 time: 0.235047 Aug 12 10:53:37.906569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 232/431] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:37 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:38.786376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:38.787071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:38.798257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:38.803240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:38.804131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:38.805015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:38.807070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:38.808117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:38.934529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:38.938550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:38.962137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:38.962655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:38.963093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:38.963807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:38.971300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:38.972777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:39.043923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:39.059323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:39.061909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:39.063152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4852bc3a-ca9d-4023-a9ca-020b341a5184 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.281183 Aug 12 10:53:39.070282 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 200/432] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:38 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:39.208115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:39.218033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2850f996-b90d-44e6-9c5b-5361af20e315 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1514 microversion: 2.1 time: 0.293079 Aug 12 10:53:39.226776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 233/433] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:38 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:40.091354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:40.092877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:40.101178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:40.101784 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:40.102323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:40.103249 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:40.103837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:40.104387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:40.242668 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:40.244794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:40.255022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:40.255910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:40.256642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:40.257852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:40.258520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:40.259150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:40.294180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:40.303211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:40.304782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:40.305961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8e4e1f86-5e81-4607-94a9-089b58c615dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.218681 Aug 12 10:53:40.306802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 201/434] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:40 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:40.423448 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:40.431664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a2158186-b467-4637-b592-57f7ab80de8a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1514 microversion: 2.1 time: 0.194332 Aug 12 10:53:40.432585 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 234/435] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:40 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:41.332099 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:41.332734 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:41.339654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:41.339832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:41.340282 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:41.341194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:41.341650 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:41.342128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:41.453916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:41.455270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:41.463349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:41.465338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:41.469467 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:41.470403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:41.470865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:41.471305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:41.518921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:41.530072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:41.531850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:41.533243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e3407785-0ac1-48c4-a5aa-874b69db1767 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.205270 Aug 12 10:53:41.553471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 202/436] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:41 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:41.587616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:41.595934 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0feaee53-0f7c-4c52-ba30-8e91daf2a56a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1472 microversion: 2.1 time: 0.145988 Aug 12 10:53:41.597215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 235/437] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:41 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1472 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:41.646763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d41efce4-6ba4-48c5-b5a4-0b483ba68026", "name": "network-vif-deleted", "tag": "ea909768-a8de-4aa8-88f2-aa7e1e75f295"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:41.657022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:41.657505 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:41.657956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:41.670807 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] Creating event network-vif-deleted:ea909768-a8de-4aa8-88f2-aa7e1e75f295 for instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 on hv-cinder-85294 Aug 12 10:53:41.676104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-36c1560d-59f7-4aac-a3bc-8ccf7743e82d req-add85a2a-31df-48bc-9d0e-dc2935de447c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033449 Aug 12 10:53:41.676731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 203/438] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:42.558123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:42.558767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:42.575288 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:42.576138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:42.577017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:42.577896 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:42.578510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:42.579089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:42.619679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:42.620543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:42.628227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:42.629035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:42.629541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:42.633045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:42.633615 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:42.634121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:42.676503 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:42.677295 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:42.677891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:42.678779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lazy-loading 'fault' on Instance uuid d41efce4-6ba4-48c5-b5a4-0b483ba68026 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:53:42.758598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:42.769036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7d01b2b1-7338-4014-b485-b24f43b70eef tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 200 len: 1309 microversion: 2.1 time: 0.153573 Aug 12 10:53:42.769978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 204/439] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:42 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 1309 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:42.786694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:42.796735 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:42.798548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:42.799985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-32cacf0e-5edb-4613-890d-a9bb4e054bfa tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.245769 Aug 12 10:53:42.801068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 236/440] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:42 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:43.273764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c510ebd4-711b-4e2c-ac4c-187934ebdce8"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:43.276575 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:43.280656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=38 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:43.284822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.285580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.286258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:43.287186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.287852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.288495 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:43.773062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0398d86a-1241-49ef-bd69-fd6a892231c1 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501022 Aug 12 10:53:43.791873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:43.792534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: d41efce4-6ba4-48c5-b5a4-0b483ba68026] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:43.800402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 205/441] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:53:43 2022] POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:43.804793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.805296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.805720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:43.807044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.807692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.808698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:43.824587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:43.825556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:43.829064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] HTTP exception thrown: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Request method failure captured: Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 HTTP/1.1 Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jDbQSd_EISndfRPFcf5TmgfFo3hvYMgzUYb759v71lNAiAk5AK9DCIVN4NJMetj3lEIaDXDeTVQcNadcaDFpJOR15omtoJiEm59Rp5jZ-SdVNptle7woodHSJK9PZdd89NhCGKi3iV6cDUGTIgV9_Lvy4ro_R35FEBaONXaWcedTdY Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: ce501b5e17df4518a2ec76763bc3d81e Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:53:43.830957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce501b5e17df4518a2ec76763bc3d81e"}]}] Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: ce501b5e17df4518a2ec76763bc3d81e Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesSnapshotTestJSON-1902145617-project Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 7bd68057dba244cabdb8efe86ee31b7e Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesSnapshotTestJSON-1902145617-project Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. Aug 12 10:53:43.832619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'd41efce4-6ba4-48c5-b5a4-0b483ba68026'} Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:53:43.833517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. Aug 12 10:53:43.834976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:43.836635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.836635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.836635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:43.836635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:43.837001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:43.837749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Returning 404 to user: Instance d41efce4-6ba4-48c5-b5a4-0b483ba68026 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:53:43.838748 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c4d65714-29eb-495b-a797-bef294c8851c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026" status: 404 len: 111 microversion: 2.1 time: 0.051484 Aug 12 10:53:43.840209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 237/442] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:43 2022] GET /compute/v2.1/servers/d41efce4-6ba4-48c5-b5a4-0b483ba68026 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:53:43.841742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:44.017240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:44.029141 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:44.031539 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:44.033086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8b815ba5-38c4-4005-9d19-3c75d87b3b81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.213160 Aug 12 10:53:44.033873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 206/443] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:43 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:44.868120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'create', calling method: .version_select at 0x7efc5cb01310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1282635168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBb7Pp3R64lEsq0aGYyjuGlmlS7CRxRhXcKOfx1W4QGh1bbGx4YIQBAihQY4JEv1f/RDAXTK4Pii9qPq/WeSMW2AO3jJ+cRgJDyGCK7N88mgAFf15dk8kkUK+RR4JaM2Xg=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:44.883384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Getting quotas for project 807c809e71de43ebb4edecbab4bc4292. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:53:44.887367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Getting quotas for user 3f40eebcea60459ab0cf9233aea9b743 and project 807c809e71de43ebb4edecbab4bc4292. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:53:44.901624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [7fcb3eb2-a9d5-4bee-9977-94569709a57c] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 12 10:53:45.066569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:45.067227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:45.074158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:45.074840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:45.075383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:45.076248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:45.076959 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:45.077384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:45.228815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:45.237847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:45.239334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:45.240532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-835374be-3d77-4da3-adf9-62a07f02bd89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.177975 Aug 12 10:53:45.241090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 207/444] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:45 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:45.909758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [7fcb3eb2-a9d5-4bee-9977-94569709a57c] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 56570. Aug 12 10:53:45.925182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b7c5ad32-0550-48db-af06-dad40f40054f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.060660 Aug 12 10:53:45.925706 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 238/445] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:53:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:46.051326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-255086585", "imageRef": "12f8aedb-7d54-481b-8d9e-c40acb0a5988", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1282635168", "networks": [{"uuid": "5ba14fbf-5180-4e4e-b8c3-5a4ec7faac8f"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:46.105268 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] validate_networks() for [('5ba14fbf-5180-4e4e-b8c3-5a4ec7faac8f', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:53:46.263655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:46.264597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:46.274140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:46.274627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:46.275056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:46.275745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:46.276365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:46.276950 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:46.493037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:46.503680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:46.505306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:46.506551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0bb150d9-c2b2-4f32-965a-c94547f2a134 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.246971 Aug 12 10:53:46.507462 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 239/446] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:46 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:53:46.605763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:53:46.606185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:53:46.606655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:53:46.607055 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:53:46.607458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:53:46.617664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:46.618114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:46.618741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:46.619473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:46.619929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:46.620409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:46.637551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Getting quotas for project 807c809e71de43ebb4edecbab4bc4292. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:53:46.642271 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Getting quotas for user 3f40eebcea60459ab0cf9233aea9b743 and project 807c809e71de43ebb4edecbab4bc4292. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:53:46.654343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:53:46.657290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12f8aedb-7d54-481b-8d9e-c40acb0a5988',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:53:46.705889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3d31d673-c727-47a2-92dc-b5e6ae14b36d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658209 Aug 12 10:53:46.706767 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 208/447] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:53:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:53:46.717533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b8671e2b-ba9a-4b26-97f2-ce1c494d9b2d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:46.718333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b8671e2b-ba9a-4b26-97f2-ce1c494d9b2d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:46.806570 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b8671e2b-ba9a-4b26-97f2-ce1c494d9b2d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:46.814892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b8671e2b-ba9a-4b26-97f2-ce1c494d9b2d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1258 microversion: 2.1 time: 0.101157 Aug 12 10:53:46.816328 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 240/448] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:46 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1258 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:47.532474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:47.533513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:47.542169 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:47.542725 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:47.543308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:47.544939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:47.545934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:47.546647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:47.549885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:47.723839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:47.734075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:47.736773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:47.738529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a4913c0c-24e2-47eb-9cf9-20475e4268ce tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.211463 Aug 12 10:53:47.739723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 209/449] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:47 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:47.838202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:47.838584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:47.846454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:47.846859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:47.847299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:47.848076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:47.848788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:47.849400 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:47.921089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:47.931413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8a1bddb3-3b33-430f-8c8f-99d90f1e79d5 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1262 microversion: 2.1 time: 0.098363 Aug 12 10:53:47.932007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 241/450] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:47 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1262 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:48.766546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:48.767162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:48.778762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:48.779390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:48.780724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:48.783591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:48.785228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:48.788991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:48.955824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:48.956619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:48.958913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:48.995329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:48.998866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:48.999548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:49.002587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:49.003910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:49.006179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:49.042343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:53:49.178565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:49.190342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-76898374-f3ed-432b-b49a-5f236e44de68 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1316 microversion: 2.1 time: 0.241478 Aug 12 10:53:49.193433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 242/451] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:48 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:49.212833 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:49.236212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:49.246421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:49.267930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c4433929-ff00-4369-9224-c926c4c7aa0e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.505628 Aug 12 10:53:49.269129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 210/452] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:48 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:50.211968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:50.212633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:50.223577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:50.224040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:50.224542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:50.225394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:50.225850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:50.226267 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:50.309380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:50.310021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:50.329748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:50.331052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:50.340392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:50.360620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:50.361131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:50.361796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:51.244726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:51.261193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:51.267181 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:51.272572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-55005b6b-3045-4062-9bea-7185e3096683 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.966723 Aug 12 10:53:51.273262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:51.275971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 211/453] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:50 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:51.282271 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-65e75c75-4143-4cbb-94de-8aeec40bf212 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 1.074613 Aug 12 10:53:51.296500 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 243/454] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:50 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:52.210772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-642938947", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "networks": [{"uuid": "748b9a03-d496-4b62-90fd-ab4a8de0c910"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:52.300175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:52.301159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:52.318089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] validate_networks() for [('748b9a03-d496-4b62-90fd-ab4a8de0c910', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:53:52.322297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:52.323013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:52.323611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:52.324519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:52.325120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:52.325694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:52.725377 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:52.738499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:52.748873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:52.752028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-773db5b1-efad-47c1-9648-c8684f2b15e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.457096 Aug 12 10:53:52.752799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 244/455] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:52 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:52.762557 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:52.764967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:52.780368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:52.784180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:52.784867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:52.785760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:52.786368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:52.787640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:53.247044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:53.257880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9fc45cb1-7dca-4888-9afa-dd886d8a343e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.501822 Aug 12 10:53:53.274615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 245/456] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:52 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:53.329175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:53:53.330485 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:53:53.331288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:53:53.331889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:53:53.332620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:53:53.346048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:53.346760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:53.347435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:53.348710 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:53.349811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:53.350552 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:53.371194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Getting quotas for project ce501b5e17df4518a2ec76763bc3d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:53:53.376810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Getting quotas for user 7bd68057dba244cabdb8efe86ee31b7e and project ce501b5e17df4518a2ec76763bc3d81e. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:53:53.395396 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:53:53.398378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:53:53.485920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-77d194c1-6b59-4b00-a1dc-4ea3d75e9051 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279140 Aug 12 10:53:53.486561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 212/457] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:53:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:53:53.499022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3ed54b39-f34c-4230-83ea-5164541de341 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:53.500614 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3ed54b39-f34c-4230-83ea-5164541de341 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:53.638528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3ed54b39-f34c-4230-83ea-5164541de341 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:53.655478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3ed54b39-f34c-4230-83ea-5164541de341 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1218 microversion: 2.1 time: 0.161680 Aug 12 10:53:53.656704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 246/458] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:53 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:53.777209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:53.778236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:53.792770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:53.794971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:53.799543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:53.800313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:53.801949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:53.808633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.239543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "name": "network-vif-plugged", "status": "completed", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:54.257390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:54.257957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:54.258446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.273341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:54.279700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] Creating event network-vif-plugged:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:53:54.286519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-fd3f0464-34ef-4257-9b43-59942717b85e req-a122231a-4d56-4ff1-b67c-74072978770a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056733 Aug 12 10:53:54.288430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 247/459] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:54.296743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:54.297300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:54.298380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:54.298963 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:54.300166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3dffaa36-303a-4d03-b49a-2b88bde54770 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.528766 Aug 12 10:53:54.305949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 213/460] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:53 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:54.307135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:54.308493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:54.309751 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.310813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:54.312040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:54.312704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.568347 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:54.577238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-935d3dec-5e64-4ead-8b43-fbcf3496f2fe tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.286885 Aug 12 10:53:54.592355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 248/461] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:54 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:54.688805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:54.689534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:54.707500 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:54.708025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:54.708511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.711673 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:54.712248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:54.713543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:54.827507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:54.838228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-592e6ae1-213c-43e2-8b84-e6e74f9a9114 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1222 microversion: 2.1 time: 0.158680 Aug 12 10:53:54.839326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 214/462] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:54 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1222 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:55.328931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:55.329468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:55.341259 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.341780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.342993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.343755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.344215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.344670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.601316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:55.602412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:55.615769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.616985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.619213 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.622966 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.625185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.626477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.635373 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:55.655228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:55.660404 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:55.663770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-658aae8d-fead-4434-84ef-23edea5882b6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.340296 Aug 12 10:53:55.666784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 249/463] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:55 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:55.868218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:55.869140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:55.893814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.895787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.901277 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.907255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:55.910679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:55.913795 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:55.929737 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:55.960391 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d94c4153-2eb9-4ef5-94bc-58f85575a7a2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.363201 Aug 12 10:53:55.961329 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 215/464] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:55 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:56.177873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:56.183742 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-77234e5d-01e9-42c1-a9ad-8bb93cc81e1f tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1222 microversion: 2.1 time: 0.321324 Aug 12 10:53:56.202434 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 250/465] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:55 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1222 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:56.431034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:56.472293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:56.472840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:56.473276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:56.507461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] Creating event network-changed:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:53:56.524818 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d83f0b35-b34c-44e4-887e-7289a96f3da4 req-1369d549-12fe-4421-838e-9892ef1e0704 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099940 Aug 12 10:53:56.525691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 216/466] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:56.696053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:56.696860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:56.726694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:56.727180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:56.727611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:56.728399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:56.736915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:56.737545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:56.985013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:56.986942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:57.003137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:57.006436 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:57.007457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:57.015804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:57.017949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:57.021233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:57.414431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:57.427568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:57.429144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:57.430677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-278d5bfd-a69b-4e02-bb20-84c144c2572e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.739804 Aug 12 10:53:57.431452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 251/467] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:56 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:57.445961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:57.446568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:57.477544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:57.489121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:57.489554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:57.490313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:57.490761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:57.491183 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:57.535296 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:57.544417 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4119c162-f8ea-4656-9735-7aa41959b57e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.565579 Aug 12 10:53:57.546773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 217/468] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:56 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:53:57.655758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:57.669617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-40a812cd-a969-4c50-b816-16c4125c4218 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1270 microversion: 2.1 time: 0.228058 Aug 12 10:53:57.674349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 252/469] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:57 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:58.181028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:58.181605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:58.196190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.196844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.197178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.197897 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.207667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.209255 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.259984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ebe39ac0-a6a4-463a-a782-475e001ba9d9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/ips" status: 200 len: 150 microversion: 2.1 time: 0.082956 Aug 12 10:53:58.268904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 218/470] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:53:58 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/ips => generated 150 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:53:58.276192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "735af54f-8b6e-42a3-95fb-e0163d86509c"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:58.279565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:58.292523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.294299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.294911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.295741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.296667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.297224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.461642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:58.462585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:58.471674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.489308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.489761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.495685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.496227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.496704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.548176 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: POST /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/os-volume_attachments HTTP/1.1 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 74 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:53:58.552240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {"volumeAttachment": {"volumeId": "735af54f-8b6e-42a3-95fb-e0163d86509c"}} Aug 12 10:53:58.553692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'server_id': 'da711dd0-ec6b-4b9c-ac84-72f961b0950f', 'body': {'volumeAttachment': {'volumeId': '735af54f-8b6e-42a3-95fb-e0163d86509c'}}} Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:58.554519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:53:58.555690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:53:58.558490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:53:58.558490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:53:58.558490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:53:58.558490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 Aug 12 10:53:58.558490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:53:58.562430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 400 to user: Invalid volume: volume 735af54f-8b6e-42a3-95fb-e0163d86509c is already attached to instances: 50312e28-f052-47cc-88c5-34ac69ff9551 {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:53:58.565776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-91b3daa6-4dad-4f36-8d79-c491c29e15d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.291410 Aug 12 10:53:58.570552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 253/471] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:53:58 2022] POST /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f/os-volume_attachments => generated 174 bytes in 296 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 10:53:58.582194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:53:58.595780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:58.616352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.616856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.617289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.617992 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.618450 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.618867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.706630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'flavor' on Instance uuid 880e761f-5cfb-427d-a5fd-07f00959ba78 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:53:58.822600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:58.840974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:58.843487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:58.845477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a285eaf2-32c1-471f-8a65-a3527a52426a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.389122 Aug 12 10:53:58.847571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 219/472] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:58 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:53:58.853604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:58.854618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:58.868842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.871144 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.871774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:58.873795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:58.874855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:58.876507 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.081166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-14d19213-7e00-4881-9352-798704745cda tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/action" status: 200 len: 32 microversion: 2.1 time: 0.508409 Aug 12 10:53:59.083258 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 254/473] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:53:58 2022] POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/action => generated 32 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:53:59.104035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:59.112973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1cbb6483-d6e9-4bec-856e-2b7d28c3a725 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.263973 Aug 12 10:53:59.115763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:59.116553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:59.129232 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 220/474] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:58 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:59.134441 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:59.135578 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:59.137811 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.138274 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.138769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.139754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.140211 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.140655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.150675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.151321 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.152238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.153094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.153618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.154103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.205123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:53:59.332641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:59.352946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-69a8d6af-fbae-414b-8414-e94dc78e358d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1288 microversion: 2.1 time: 0.222106 Aug 12 10:53:59.353510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 221/475] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:59 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1288 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:59.359326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:59.360205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:59.367873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.368654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.369890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.370792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.371433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.372187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.394493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d0a5d474-8186-488f-a6a9-dd758567692e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 204 len: 0 microversion: 2.1 time: 0.308652 Aug 12 10:53:59.395446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 255/476] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:53:59 2022] DELETE /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:53:59.405127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:59.413293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:59.420766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.421426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.423333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.423728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.424789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.425339 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.713431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:59.731555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d0255a8d-34f3-4372-9309-1ff1fdb9cc88 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.376194 Aug 12 10:53:59.733032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 222/477] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:59 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:59.832969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:53:59.852740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-881eddd7-4a7b-4a9f-aa6b-78d985b76c11 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1683 microversion: 2.1 time: 0.451911 Aug 12 10:53:59.853572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 256/478] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:53:59 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1683 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:53:59.877223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:53:59.877889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:53:59.887334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.887834 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.888950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:53:59.889925 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:53:59.890398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:53:59.891304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.095302 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.110388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.112090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.113514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-575ca367-9e52-49c0-8dd9-a7a3e2fd3f97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.244009 Aug 12 10:54:00.114438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 223/479] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:53:59 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:00.137082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:00.137692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:00.152300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.154287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.154753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.155488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.155935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.156378 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.168280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:00.377387 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.377620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:00.378529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:00.385055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-628a346d-a7e5-4227-b026-1a0e6d93f555 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.252193 Aug 12 10:54:00.388488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 257/480] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:00 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:00.398427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.399502 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.399940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.400715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.401166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.401583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.477783 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.487722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-291417d0-7932-41e0-a9cc-f3ad1a2c5631 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1276 microversion: 2.1 time: 0.114732 Aug 12 10:54:00.488829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 224/481] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:00 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:00.761054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:00.765168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:00.772901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.774962 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.775630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.777983 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.779608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.781062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.877424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:00.879106 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:00.889719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.891393 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.892118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.893865 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:00.894573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:00.895336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:00.947232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:00.961146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3cf956e9-155a-468e-9b61-9d1075ebadd2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.206855 Aug 12 10:54:00.962823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 258/482] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:00 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:01.050402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.059798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6dfa2507-91fb-41b8-8b10-ede1d8848e90 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1683 microversion: 2.1 time: 0.188147 Aug 12 10:54:01.060937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 225/483] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:00 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1683 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:01.137672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:01.138060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:01.144848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.145488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.146321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.147033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.147485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.147907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.310717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.325179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.328023 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.329441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e954f835-4241-47a9-a58f-aa37653b64f1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.196450 Aug 12 10:54:01.336391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 259/484] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:54:01 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:01.406280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:01.406888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:01.413299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.413776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.414242 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.414949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.415398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.415814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.511038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:01.511366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:01.524738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.525235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.525669 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.526386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.526843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.527262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.713482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.730025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0c46481a-146c-4c7f-a5ff-0ade288b4349 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1276 microversion: 2.1 time: 0.224089 Aug 12 10:54:01.730611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 260/485] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:01 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:01.758697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:01.775903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fb966c17-6f22-48b1-ba89-ae486d3980f0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.372799 Aug 12 10:54:01.777484 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 226/486] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:01 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:01.983447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:01.983993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:01.991986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.992515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.992955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:01.993668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:01.994125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:01.994558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.010558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=100 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:02.049814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1871a907-6083-49da-84d7-e471034dda7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Action: 'create', calling method: .version_select at 0x7efc5c9cdca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-902672255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOH4OL5/I6GxM4/QBUDQfSt7s7Vr+TdLZ1/o2egSQ4uLX2E5mGObeGhhPSw1+hi1y7SAkEGL7atPFKCI039Jj4+WOQCLe0Et4B1TkOouaVRmRjUx+JbQPrRmXTpH5m0FWA=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:02.066887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-1871a907-6083-49da-84d7-e471034dda7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for project 89943304402242278f5614ea5bde6092. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:54:02.071148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-1871a907-6083-49da-84d7-e471034dda7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for user 922f49fa7d324ebdade043e1be1a476f and project 89943304402242278f5614ea5bde6092. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:54:02.096510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1871a907-6083-49da-84d7-e471034dda7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.270949 Aug 12 10:54:02.097435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 261/487] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:54:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:02.102158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:02.102771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:02.109369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.109868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.110306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.111017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.111468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.111897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.170586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.181087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1997c73a-a454-4c9d-80ae-899ce63e76e7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.201523 Aug 12 10:54:02.182223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 227/488] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:01 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:02.274619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.284322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7e067c64-0987-4453-a7c3-9b5a53ad3340 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1683 microversion: 2.1 time: 0.185819 Aug 12 10:54:02.285179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 262/489] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:02 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:02.358582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:02.359251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:02.366791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.367290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.367731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.368466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.368922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.369353 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.658249 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.667944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.670424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.671768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0e8a8180-68df-401e-a33d-ea80a1aeab48 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.317787 Aug 12 10:54:02.672919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 228/490] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:54:02 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:02.756790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:02.758285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:02.768052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.768806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.770983 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.771913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.772558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.773594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.799464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:02.800422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:02.813258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.814343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.814861 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.817100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:02.823570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:02.824377 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:02.883022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:02.892217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4ddd8904-7d1d-48c9-8b85-2edaf08ea140 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1276 microversion: 2.1 time: 0.141764 Aug 12 10:54:02.892922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 263/491] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:02 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:03.060532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.069862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b1b902c1-d193-498e-b23d-500a85210e3f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.275327 Aug 12 10:54:03.070429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 229/492] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:02 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:03.205745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:03.206626 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:03.214824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.215511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.216323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.217142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.217538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.218128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.306140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:03.306927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:03.319093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.319596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.320059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.320801 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.321256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.321683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.362050 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=4 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:03.394243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=12 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:03.711009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.720348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-eafcf761-ecbd-473f-85b9-073dcb04f59b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.518973 Aug 12 10:54:03.720752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 264/493] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:03 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:03.725378 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:03.726092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:03.738584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.739078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.739507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.740234 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.740749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.741168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.746205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.757759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bf7978e0-150b-4757-99d1-224997307970 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1683 microversion: 2.1 time: 0.455482 Aug 12 10:54:03.760175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 230/494] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:03 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1683 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:03.917608 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:03.919454 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:03.937876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.939819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.940732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.941956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:03.943012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:03.943690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:03.955117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.986077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.988421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:03.990435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4de7f8ad-8d4a-4504-98b7-a4c870162294 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.268755 Aug 12 10:54:03.991483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 265/495] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:54:03 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:04.092049 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:04.092698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:04.107069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.108639 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.109349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:04.110588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.112653 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.113383 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:04.466788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:04.497374 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-94c85608-ea56-4ded-9264-1488c997fea5 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.577212 Aug 12 10:54:04.498267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 231/496] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:03 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:04.582276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:04.603609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-798996f9-1bb8-4edc-aa33-667f5c7b35a6 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.508299 Aug 12 10:54:04.604599 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 266/497] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:04 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:04.743032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:04.744116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:04.751914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.753054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.753644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:04.755371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.756779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.757396 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:04.781759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:04.782725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:04.796165 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.797960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.798727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:04.800665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:04.802553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:04.803915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.114670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:05.119617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:05.132629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-63949cc5-47b7-4781-be2f-204d9203676e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1683 microversion: 2.1 time: 0.354147 Aug 12 10:54:05.134547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 267/498] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:04 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1683 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:05.151458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-52946859-974d-4da3-bc50-633a2680fb25 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.413462 Aug 12 10:54:05.153292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:05.154105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:05.154743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 232/499] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:04 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:05.175636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.176452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.177105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.178188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.179017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.179630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.503515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:05.506410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef286192-016a-4c27-ac92-5ebeabb797c5", "tag": "39fe8d64-c46a-4681-b204-b2d38747327b"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:05.537413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:05.540137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:05.541673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-39a0a061-c7f1-425b-bbeb-3fa5d7c54d89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1810 microversion: 2.20 time: 0.405874 Aug 12 10:54:05.555879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 268/500] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:54:05 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1810 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:05.569150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.573348 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.579568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:05.582316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.587266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:05.605385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.606410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.607186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.608435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.609105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.609672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.617816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] Creating event network-changed:39fe8d64-c46a-4681-b204-b2d38747327b for instance ef286192-016a-4c27-ac92-5ebeabb797c5 on hv-cinder-85294 Aug 12 10:54:05.627623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-39216b39-691c-4b7a-a36a-d404b41afdc9 req-ade4732f-dd70-4977-9106-fc48729efc92 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131610 Aug 12 10:54:05.637100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 233/501] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:05.648718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:05.650356 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:05.658989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.659876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.660705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:05.662096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:05.662714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:05.663759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.391940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:06.402311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cacf3ed2-34d1-4270-9641-0caed21a40d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.763444 Aug 12 10:54:06.402887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 234/502] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:05 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:06.414069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da711dd0-ec6b-4b9c-ac84-72f961b0950f", "name": "network-vif-deleted", "tag": "34f2c281-a84a-48d1-be8a-c806349087ac"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:06.441431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.441913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.442341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.479700 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] Creating event network-vif-deleted:34f2c281-a84a-48d1-be8a-c806349087ac for instance da711dd0-ec6b-4b9c-ac84-72f961b0950f on hv-cinder-85294 Aug 12 10:54:06.501996 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-427b9f68-bc12-4193-9fa2-d95d4f5b1f37 req-def836fc-3dab-4125-a51b-6d7ac0140844 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093274 Aug 12 10:54:06.502902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 235/503] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:06.508926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:06.509723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:06.531404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.532655 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.533792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.541548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.542278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.542876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.560493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:06.568251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7818cad6-36da-489a-8654-aad3d02b6b2a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 1.007698 Aug 12 10:54:06.568880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 269/504] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:05 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:06.587468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:06.594717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:06.604865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.606387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.606520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.607030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.607455 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.607955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.608216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.608605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.609012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lazy-loading 'fault' on Instance uuid da711dd0-ec6b-4b9c-ac84-72f961b0950f {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:06.609129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.718028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:06.733021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7ad4380a-f29a-46bb-a314-9b7e2ce2a897 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 200 len: 1332 microversion: 2.1 time: 0.228532 Aug 12 10:54:06.734566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 236/505] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:06 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 1332 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:06.739558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:06.750380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:06.757821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.758570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.759174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.760059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:06.764236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:06.764968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:06.990837 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:06.999351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-96042de1-ddc8-42dc-a675-4cde3fdbcfa2 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.429417 Aug 12 10:54:07.013562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 270/506] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:06 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:07.105472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:07.121571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:07.124748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:07.127112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a78d02fe-6ad9-4759-807c-3e945031ee02 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1797 microversion: 2.20 time: 0.390961 Aug 12 10:54:07.128033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 237/507] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:54:06 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1797 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:54:07.423679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:07.424421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:07.431000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.431574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.432111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.433078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.433534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.433953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.572485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:07.580578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7e3956cc-e334-4566-90cc-fdaf7ef3f54e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.161138 Aug 12 10:54:07.581265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 271/508] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:07 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:07.590116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:07.591487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:07.598903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.599635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.600216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.601113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.601868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.602567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.754327 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:07.755137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:07.755894 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:07.762076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ecd6a690-c372-482f-9844-e5ed8a236f9e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.176190 Aug 12 10:54:07.765911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.766676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.767280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.768159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:07.768777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:07.769350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:07.775659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 238/509] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:07 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:07.791961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f HTTP/1.1 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:54:07.794203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:54:07.795876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'da711dd0-ec6b-4b9c-ac84-72f961b0950f'} Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:54:07.796821 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:54:07.798264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:07.799600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:54:07.800511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b9f7c1fb-6485-46cd-9a9b-911a342b4b00 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 404 len: 111 microversion: 2.1 time: 0.049280 Aug 12 10:54:07.801177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 272/510] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:07 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:54:07.809878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-22709acb-30da-40e3-a888-fba3389394dc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '.version_select at 0x7efc5c9d49d0>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:07.818407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:07.837972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-22709acb-30da-40e3-a888-fba3389394dc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304482335" status: 202 len: 0 microversion: 2.1 time: 0.032038 Aug 12 10:54:07.839348 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 239/511] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Aug 12 10:54:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304482335 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:54:08.022018 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:08.022775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:08.042875 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.056750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.062292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:08.063850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.074392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.074858 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:08.413979 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:08.429401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-64492bd1-3b34-4bb0-b2b0-0cb7ab929298 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.412104 Aug 12 10:54:08.429996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 273/512] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:08 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:08.606977 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:08.607634 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:08.615975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.616504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.616944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:08.617649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.618101 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.618561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:08.784727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:08.785335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:08.791358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.791833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.792338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:08.792988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:08.793427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:08.793838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.002984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:09.011229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ff917a82-527d-4ae4-9386-b231d87af805 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.407969 Aug 12 10:54:09.011762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 240/513] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:08 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:09.131682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:09.140365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cd00a7bf-38d5-40c3-8ad3-240eb5bafa42 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.360399 Aug 12 10:54:09.155998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 274/514] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:08 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:09.344391 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:09.344890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:09.351385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.351868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.352342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.353063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.353551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.353949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.455764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:09.456510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:09.462965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.463433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.463880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.464620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.465070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.465498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.486629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:09.488736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lazy-loading 'services' on Instance uuid 50312e28-f052-47cc-88c5-34ac69ff9551 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:09.603877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-48e57d54-5386-47e7-921b-2a6b3b99b672 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments/735af54f-8b6e-42a3-95fb-e0163d86509c" status: 202 len: 0 microversion: 2.1 time: 0.263825 Aug 12 10:54:09.604710 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 241/515] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:54:09 2022] DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments/735af54f-8b6e-42a3-95fb-e0163d86509c => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:54:09.614388 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:09.614611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:09.615554 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:09.623515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.624048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.624520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.625003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3fcbf9fe-6eae-4d51-a60e-4753ff44d485 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.174238 Aug 12 10:54:09.625225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:09.625590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 275/516] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:09 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:09.625764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:09.626203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:09.657512 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-13fad861-6f23-4023-9a59-23029fd31e32 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048276 Aug 12 10:54:09.658064 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 242/517] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:54:09 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:10.034898 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:10.035513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:10.043762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.044298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.044800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.045572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.046059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.046480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.112737 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "name": "network-vif-plugged", "status": "completed", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:10.123599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.124486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.125471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.139789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] Creating event network-vif-plugged:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:54:10.145514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-7348725e-bc2b-4d94-895a-c7264391f1a7 req-4f02cc4d-a2e5-44b7-8ec4-d8efa545b5a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036481 Aug 12 10:54:10.147038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 243/518] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:10.164317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:10.165024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:10.171440 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.171935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.172474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.173186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.173639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.174067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.190069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:10.197535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9bd39f92-1009-4cfa-a14a-19611a9e7471 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.166908 Aug 12 10:54:10.198105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 276/519] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:10 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:10.316323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:10.329725 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-16d64ec8-9d92-4c94-bb64-0824a43fa38a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.169504 Aug 12 10:54:10.330324 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 244/520] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:10 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:10.647994 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:10.648617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:10.654676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.655229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.655766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.656479 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.656925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.657346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.669887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:10.672202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:10.679012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.679489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.679936 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.680675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:10.681245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:10.681674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:10.714868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ec8ca277-b7a4-4b9d-8435-328538ab4483 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048814 Aug 12 10:54:10.715437 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 245/521] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:54:10 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:10.803397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:10.812059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a9d2f2b0-39ea-4e53-b0ae-35cc8aaf3003 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.168262 Aug 12 10:54:10.812976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 277/522] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:10 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:11.223796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.224913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.233838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.234334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.234772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.235493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.235950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.236406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.239421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:11.352305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.354775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.364189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.365340 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.365848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.366655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.367144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.367578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.376306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:11.391499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e33c314c-d1a4-4420-90bd-beae1bd6fa4d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1358 microversion: 2.1 time: 0.174402 Aug 12 10:54:11.392128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 246/523] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:11 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:11.517818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:11.526793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-33a74cf2-aa9e-47d2-8766-fdecc5dea273 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.179504 Aug 12 10:54:11.527590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 278/524] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:11 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:11.728430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.730570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.737761 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.738243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.738675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.739378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.739821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.740340 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.771027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-da7e5469-95d4-4fae-8275-3760dce48e85 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046275 Aug 12 10:54:11.771608 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 247/525] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:54:11 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:54:11.833684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.834301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.838121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.838782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.840561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.841079 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.841545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.843329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.843787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.844216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.845353 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.845833 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.846266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.846953 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.847370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.847788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.872672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:54:11.959658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-76d9dfff-55dd-4048-9729-6c2d0293c7de tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 204 len: 0 microversion: 2.1 time: 0.124913 Aug 12 10:54:11.960435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 248/526] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:54:11 2022] DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:54:11.970973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:11.972491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:11.980203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.981118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.982105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.983639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:11.984107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:11.984760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:11.984880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:11.997545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-16b92b95-0a5e-4b71-a5eb-effeb80f3da7 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.167525 Aug 12 10:54:12.000307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 279/527] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:11 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:12.135361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:12.143658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8ca3bd4d-27af-4deb-be28-dbc0389f1018 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1682 microversion: 2.1 time: 0.178985 Aug 12 10:54:12.153306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 249/528] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:11 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:12.413251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:12.413846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:12.415919 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=12 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:12.422199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.422703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.423121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.423811 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.424311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.424755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.548576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:12.549153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:12.555455 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.555942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.556446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.557130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.557584 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.558008 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.564599 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:12.572514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f11e739f-292b-4449-bab9-dd7a2ad69b4b tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1547 microversion: 2.1 time: 0.163120 Aug 12 10:54:12.573069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 280/529] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:12 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:12.594391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:12.595299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:12.601354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.601832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.602425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.603374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.603837 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.604350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.742867 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:12.751620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c4cb03f4-2a63-4b81-a277-aece2608393d tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.206891 Aug 12 10:54:12.752183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 250/530] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:12 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:12.773384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:12.781435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c5b5aedd-3fd5-4528-b416-0e79f6bde44d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1547 microversion: 2.1 time: 0.191724 Aug 12 10:54:12.782198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 281/531] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:12 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:12.801622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:12.806512 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:12.807284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Searching by: {'deleted': False, 'project_id': '807c809e71de43ebb4edecbab4bc4292'} {{(pid=132239) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 12 10:54:12.814401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.814880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.815317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.816040 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:12.816522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:12.817128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:12.907912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.multi_cell_list [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132239) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 12 10:54:13.009165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ac660040-ebbf-427c-b33e-017e9cf2138d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211295 Aug 12 10:54:13.009647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 251/532] 10.222.0.23 () {58 vars in 1125 bytes} [Fri Aug 12 10:54:12 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:13.019566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:13.020369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:13.021264 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:13.021876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:13.026763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.027249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.027714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.027851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.028156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.028601 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.028739 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.029053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.029629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.037535 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.038029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.038471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.245422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:13.249524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:13.254239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c756d003-f2c2-44b2-a8c0-2626886a412c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.238647 Aug 12 10:54:13.260939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 282/533] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:13 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:13.260939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:13.260939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:13.261785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:13.264110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-afdac122-a231-4605-9827-4aa2d91c0ee8 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1547 microversion: 2.1 time: 0.246858 Aug 12 10:54:13.265185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 252/534] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:13 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1547 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:13.268220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.268933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.269372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.270220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.270642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.271439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.427059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:13.435195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ab888d00-46fe-42c8-a52b-33cf5b344602 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1682 microversion: 2.1 time: 0.179445 Aug 12 10:54:13.435955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 283/535] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:13 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:13.773186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:13.773726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:13.780855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.781349 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.781790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.782490 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:13.782944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:13.783372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:13.925783 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:13.933778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d2726512-7df8-4621-bf76-d7c1ba0f563a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.164861 Aug 12 10:54:13.934360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 253/536] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:13 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:14.163682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef286192-016a-4c27-ac92-5ebeabb797c5", "name": "network-vif-plugged", "status": "completed", "tag": "39fe8d64-c46a-4681-b204-b2d38747327b"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:14.174902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.175382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.175812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.187970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] Creating event network-vif-plugged:39fe8d64-c46a-4681-b204-b2d38747327b for instance ef286192-016a-4c27-ac92-5ebeabb797c5 on hv-cinder-85294 Aug 12 10:54:14.193079 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-aafdc53b-305a-4bfe-b4b2-cd9de3c16ccd req-245e3726-a634-49df-adb0-725acd01a61a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033258 Aug 12 10:54:14.193665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 284/537] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:14.277069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:14.277648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:14.283913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.284413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.284853 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.285558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.286015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.286439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.423738 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:14.431920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-162f31f8-22ad-4095-9f1f-86d30c479595 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.159192 Aug 12 10:54:14.432553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 254/538] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:14 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:14.460472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:14.461692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:14.469815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.470255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.470915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.471610 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.472052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.472580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.850671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "101e424c-75e6-47a5-ba91-0d3e6c84fc3b"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:14.853234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:14.860898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.861497 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.862003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:14.862787 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:14.863314 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:14.863830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.016017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:15.027364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2706b3ef-27a9-46be-b50c-01aca3f9581b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1682 microversion: 2.1 time: 0.573385 Aug 12 10:54:15.027915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 285/539] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:14 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1682 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:15.032630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:15.033226 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:15.039009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:15.039483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:15.040172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.040887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:15.041488 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:15.041904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.182107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c025890b-f50d-4a03-a520-c0fb066b431f tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335478 Aug 12 10:54:15.182723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 255/540] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:54:14 2022] POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:15.367217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:15.374954 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2f5b9c7a-daf1-4ab4-a9c9-9d353b6ec1d9 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1318 microversion: 2.1 time: 0.346012 Aug 12 10:54:15.375528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 286/541] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:15 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:15.466228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:15.467281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:15.477137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:15.482162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:15.482881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.483604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:15.484084 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:15.484536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.749070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:15.757684 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d0607e98-3bd6-44dc-9184-7e2b823a8d97 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.307239 Aug 12 10:54:15.767776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 256/542] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:15 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:15.962452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50312e28-f052-47cc-88c5-34ac69ff9551", "name": "network-vif-deleted", "tag": "dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:15.972201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:15.972752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:15.973138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:15.985838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] Creating event network-vif-deleted:dddb6ef3-43d7-4a3a-9cba-22756d9f9fb2 for instance 50312e28-f052-47cc-88c5-34ac69ff9551 on hv-cinder-85294 Aug 12 10:54:15.990762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c6975599-62eb-4c37-b89c-96a40aa32f1e req-5faa2748-408e-41d6-9e56-5b201e3b1b8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031918 Aug 12 10:54:15.991362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 287/543] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:16.050189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:16.051538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:16.058379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.058867 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.059301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.060004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.060551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.061323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.133287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:16.141117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6b1b9ee1-0afb-4b78-9b30-b886421ad1a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1615 microversion: 2.1 time: 0.095637 Aug 12 10:54:16.142205 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 257/544] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:16 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:16.396409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:16.397064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:16.403184 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.403656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.404082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.404906 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.405354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.405786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.570621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:16.579222 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9535f4bd-6350-471f-b3f1-df430d3e242a tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1507 microversion: 2.1 time: 0.187727 Aug 12 10:54:16.579810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 288/545] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:16 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:16.601124 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a58935b-57fd-42d6-a355-42bd13d61929", "device": "/dev/sdb"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:16.603865 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:16.612729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.613392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.613828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.614718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.615175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.615603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.779931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:16.780700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:16.787098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.787574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.788006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.788741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:16.789189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:16.789606 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:16.833458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:16.946313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:16.956566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e11d3667-a82f-4b4b-9706-17070e019efc tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.180920 Aug 12 10:54:16.957121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 289/546] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:16 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:16.982062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f111fdd0-cd37-4a79-8921-e331a2e0d30e tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "POST /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385364 Aug 12 10:54:16.983511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 258/547] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:54:16 2022] POST /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:17.163552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:17.164181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:17.171139 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:17.171931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:17.172521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:17.173296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:17.173743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:17.174158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:17.205554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:17.206016 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:17.206437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:17.206878 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lazy-loading 'fault' on Instance uuid 50312e28-f052-47cc-88c5-34ac69ff9551 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:17.253517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:17.262584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2731f8ec-abd0-48cc-866d-617782d95238 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 200 len: 1331 microversion: 2.1 time: 0.103195 Aug 12 10:54:17.263145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 290/548] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:17 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:17.981841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:17.983281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:17.990125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:17.990629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:17.991062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:17.991749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:17.992198 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:17.992654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:18.131736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:18.139856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-93318631-4468-435e-b133-19d70cd7feb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.163052 Aug 12 10:54:18.140476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 259/549] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:17 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:18.289783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:18.290597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:18.298702 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:18.299181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:18.299608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:18.300429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:18.300860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:18.301279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:18.315126 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 HTTP/1.1 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:54:18.317149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:54:18.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '50312e28-f052-47cc-88c5-34ac69ff9551'} Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:54:18.319417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:54:18.320843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:54:18.322197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:54:18.322197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-db0696f4-7b8a-4963-860b-ebc9f012dfa8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 404 len: 111 microversion: 2.1 time: 0.034874 Aug 12 10:54:18.322197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 291/550] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:18 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:54:18.327582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bccf045b-8c09-4b9d-b0e5-e2d99b43e995 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '.version_select at 0x7efc5c8398b0>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:18.347347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bccf045b-8c09-4b9d-b0e5-e2d99b43e995 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721208082" status: 202 len: 0 microversion: 2.1 time: 0.023539 Aug 12 10:54:18.348182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 260/551] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Aug 12 10:54:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721208082 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:54:19.014111 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dc37d258-f35d-4965-89fc-52364220a517 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: .version_select at 0x7efc5ca869d0>, body: {"keypair": {"name": "tempest-keypair-772306550", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI16omn3j5Ebh6PpyWOqlODXqLitifncLHFIubuDOmpwMtNC1/A0HbIqvAQh48tpIVaXgpvtm4nV9PJjMVNz2R3MFcRSfJORmmI6VE6UJn0pt/h0tZzvqUXH8q5I6vMMzQ=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:19.037862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-dc37d258-f35d-4965-89fc-52364220a517 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:54:19.042141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-dc37d258-f35d-4965-89fc-52364220a517 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:54:19.069898 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dc37d258-f35d-4965-89fc-52364220a517 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059627 Aug 12 10:54:19.070712 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 292/552] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:54:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:19.172140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:19.172773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:19.179580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:19.180136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:19.180678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:19.181451 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:19.181976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:19.182466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:19.346119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:19.353547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-475e98e2-a47a-4433-a6d5-8e2538997aff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.186274 Aug 12 10:54:19.354132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 261/553] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:19 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:20.375365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:20.375970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:20.382166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:20.382640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:20.383072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:20.383781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:20.384216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:20.384665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:20.460529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1709319485", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4619fc67-f793-4a22-b0bd-06a8104796b2"}], "security_groups": [{"name": "tempest-securitygroup--416580541"}], "key_name": "tempest-keypair-772306550", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:20.527499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:20.536798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0fc4f984-ac3a-4a68-8f73-efa4a40f61ed tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.165823 Aug 12 10:54:20.546466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 293/554] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:20 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:20.583748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] validate_networks() for [('4619fc67-f793-4a22-b0bd-06a8104796b2', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:54:20.707155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2065102245", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902672255", "security_groups": [{"name": "tempest-secgroup-smoke-1804087682"}], "block_device_mapping_v2": [{"uuid": "a38c3bb6-9367-4f7a-a742-3f422a1551a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5449083c-84b0-405b-91f7-10223968ec01"}]}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:20.878650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] validate_networks() for [('5449083c-84b0-405b-91f7-10223968ec01', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:54:21.098281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:54:21.098708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:54:21.099184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:54:21.099595 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:54:21.099989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:54:21.109754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.110242 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.110682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.111436 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.111911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.112354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.129367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:54:21.133292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:54:21.144733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:54:21.147487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:54:21.195555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8f020f19-97d1-46e5-a432-0aaac5c22f68 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.739160 Aug 12 10:54:21.196596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 262/555] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:54:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 10:54:21.207371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d00e3e53-38c7-47ee-ba73-460553f6f173 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:21.208200 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d00e3e53-38c7-47ee-ba73-460553f6f173 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:21.277126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d00e3e53-38c7-47ee-ba73-460553f6f173 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:21.291182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d00e3e53-38c7-47ee-ba73-460553f6f173 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1241 microversion: 2.1 time: 0.081282 Aug 12 10:54:21.291182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 263/556] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:21 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:21.398228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:54:21.398866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:54:21.399137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:54:21.399542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:54:21.399950 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:54:21.410326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.411027 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.411462 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.412192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.412681 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.413103 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.429762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:54:21.434060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for user 922f49fa7d324ebdade043e1be1a476f and project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:54:21.494748 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:54:21.502897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a38c3bb6-9367-4f7a-a742-3f422a1551a2',volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:54:21.559990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:21.560884 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:21.570042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.570838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.572381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.573444 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:21.574366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:21.575142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:21.668471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5b68f9e1-2c0c-408a-9c51-44fa601077d9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.965069 Aug 12 10:54:21.669113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 294/557] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:54:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 966 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 12 10:54:21.682212 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-87b3e9f7-2bbe-4cec-9c9e-703bc432c340 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:21.684709 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-87b3e9f7-2bbe-4cec-9c9e-703bc432c340 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:21.755603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-87b3e9f7-2bbe-4cec-9c9e-703bc432c340 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:21.761380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:21.766977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-87b3e9f7-2bbe-4cec-9c9e-703bc432c340 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1094 microversion: 2.1 time: 0.090147 Aug 12 10:54:21.768059 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 295/558] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:21 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:21.774298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4b237d9c-3894-43e2-a769-4ff788a4075d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.219608 Aug 12 10:54:21.785163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 264/559] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:21 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:22.304907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:22.305865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:22.314325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.314812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.315242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.315947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.316431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.317033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.336552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:22.388097 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:22.396374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5d909567-16fa-4b2e-bb14-aaf0712d6a03 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1237 microversion: 2.1 time: 0.095001 Aug 12 10:54:22.397312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 296/560] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:22 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:22.797781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:22.798405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:22.800528 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:22.801128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:22.805439 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.805940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.806372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.807073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.807526 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.807779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.807952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.808292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.808736 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.809432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:22.809877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:22.810304 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:22.913319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:22.921477 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2e14fa37-f439-46a6-836c-584fdf641edc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1136 microversion: 2.1 time: 0.124812 Aug 12 10:54:22.922073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 297/561] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:22 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1136 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:22.997290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:23.006171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-43209136-2a90-4249-9d9b-0eccb40a3833 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.213636 Aug 12 10:54:23.006748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 265/562] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:22 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:23.418282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:23.418886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:23.425515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:23.425998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:23.426434 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:23.427125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:23.427575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:23.428001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:23.502983 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:23.510823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9ae78e85-0c27-4c19-aa30-080dea219dd4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1293 microversion: 2.1 time: 0.096357 Aug 12 10:54:23.511376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 298/563] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:23 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:23.943122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:23.943714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:23.950583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:23.951154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:23.952089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:23.952883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:23.953342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:23.953769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.016414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:24.024663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-42dbffc0-77e4-48c0-bffd-932c2b7f6c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1192 microversion: 2.1 time: 0.085494 Aug 12 10:54:24.025228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 266/564] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:23 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:24.033681 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:24.034282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:24.040677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.041145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.041595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.042279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.042791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.043233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.188181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:24.196546 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3a6c4ce1-eb01-48b4-8437-0169e0fe4b4b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.166852 Aug 12 10:54:24.197040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 299/565] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:24 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:24.531888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:24.532729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:24.539269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.539749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.540182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.541130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.541736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.542352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.608184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:24.616076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8d6e82bd-fca4-4e11-9c21-9af1f40cc064 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1301 microversion: 2.1 time: 0.088307 Aug 12 10:54:24.617329 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 267/566] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:24 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:24.938721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:24.939324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:24.945312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.945790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.946221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:24.946912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:24.947360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:24.947781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.048054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:25.049459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:25.057161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.057875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.058468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.059504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.060114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.060857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.180884 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:25.189771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d7d80719-5e7e-41a1-86ea-0dd7d6595ae7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1593 microversion: 2.1 time: 0.255068 Aug 12 10:54:25.194729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 300/567] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:24 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1593 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:25.214558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:25.218187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:25.218813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:25.224932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-54424127-0d71-4c34-bd9d-df799c9108ee tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1200 microversion: 2.1 time: 0.182934 Aug 12 10:54:25.225728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 268/568] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:25 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1200 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:25.237595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.238101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.238542 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.239266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.239707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.240135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.425199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:25.433792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2bbbb096-3702-4217-94d8-a0fa879bfc74 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.219657 Aug 12 10:54:25.434380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 301/569] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:25 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:25.637707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:25.638332 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:25.645544 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.646351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.646796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.647550 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:25.648037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:25.648492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:25.813732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:25.821304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-82d2e146-9c6d-4b17-8193-4448126ee7d6 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1299 microversion: 2.1 time: 0.187910 Aug 12 10:54:25.821858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 269/570] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:25 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:26.246710 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:26.248731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:26.255951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.256550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.257176 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.257949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.258402 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.258811 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.347070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:26.355078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-09684f26-76d6-496a-a443-44a83fde0161 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1210 microversion: 2.1 time: 0.112237 Aug 12 10:54:26.355641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 302/571] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:26 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:26.455424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:26.456037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:26.462644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.463127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.463563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.464270 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.464726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.465143 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.692846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:26.701620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0a502dee-65df-4e8b-b88b-aa23e203f813 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1735 microversion: 2.1 time: 0.250147 Aug 12 10:54:26.702210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 270/572] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:26 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1735 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:26.843381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:26.844002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:26.850419 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.851001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.851935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.852725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:26.853536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:26.854110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:26.978506 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:26.989158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-cfe12519-a884-451d-88f3-eede92e005ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1299 microversion: 2.1 time: 0.150505 Aug 12 10:54:27.004433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 303/573] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:26 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1299 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:27.382863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:27.386690 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:27.409123 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:27.409629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:27.410073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:27.411173 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:27.411292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:27.411663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:27.713922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:27.738908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:27.739419 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:27.739901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:27.778760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:27.786112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] Creating event network-changed:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:54:27.788932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0defc993-f097-430b-a7a9-7ea5e51cac99 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.411622 Aug 12 10:54:27.792000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 271/574] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:27 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:27.807010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c0577d84-8000-48e9-a92f-45f0b72d36c5 req-552b86ca-a02e-4d61-9d4e-e86a8a390b5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096837 Aug 12 10:54:27.807622 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 304/575] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:27.809158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:27.810016 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:27.824603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:27.826153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:27.828316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:27.829233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:27.833405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:27.833945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.011284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:28.011997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:28.028104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.028630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.029073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.029970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.030552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.030985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.237912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:28.248702 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-df484c34-b1cb-4145-8dd2-e283187a016c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1715 microversion: 2.1 time: 0.455214 Aug 12 10:54:28.255730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 272/576] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:27 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1715 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:28.376521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:28.377623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:28.381846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:28.385577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.386448 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.387078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.388446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.389148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.389815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.392109 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-01da236c-dd0d-45f3-8739-e2c969f147e8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.385057 Aug 12 10:54:28.392926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 305/577] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:28 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:28.492513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] HTTP exception thrown: Cannot 'detach_volume' instance 880e761f-5cfb-427d-a5fd-07f00959ba78 while it is in vm_state rescued Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Request method failure captured: Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments/c510ebd4-711b-4e2c-ac4c-187934ebdce8 HTTP/1.1 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBxx2qKhRWtVhvGuh4sEchgFVSGUIa--BMtLwuTuBpLIUtlMsFEmoEx5LnJVmgWRKw38eDPWOit2ByMv2oo007-7Kvzos32s8GTLgK16gfwrOC0b2HaUnFROCskJU4hSxBp4fDlrw5Cyn-AvRtWWZAyBPrhRzLv72BYk2wP63FCsN0 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:54:28.497789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc63f648a390465e94ab8170362a9b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}] Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 58e209063f5c454d87d9f743bedfc734 Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:54:28.499706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Cannot 'detach_volume' instance 880e761f-5cfb-427d-a5fd-07f00959ba78 while it is in vm_state rescued Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'server_id': '880e761f-5cfb-427d-a5fd-07f00959ba78', 'id': 'c510ebd4-711b-4e2c-ac4c-187934ebdce8'} Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:54:28.500652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 880e761f-5cfb-427d-a5fd-07f00959ba78 while it is in vm_state rescued Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 880e761f-5cfb-427d-a5fd-07f00959ba78 while it is in vm_state rescued Aug 12 10:54:28.501816 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:28.504188 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Returning 409 to user: Cannot 'detach_volume' instance 880e761f-5cfb-427d-a5fd-07f00959ba78 while it is in vm_state rescued {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:54:28.505719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f1c15832-f01b-4b11-b735-23f67ff90283 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments/c510ebd4-711b-4e2c-ac4c-187934ebdce8" status: 409 len: 152 microversion: 2.1 time: 0.134639 Aug 12 10:54:28.506800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 273/578] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:54:28 2022] DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments/c510ebd4-711b-4e2c-ac4c-187934ebdce8 => generated 152 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 12 10:54:28.516058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:28.516625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:28.524231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.524912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.525360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.526900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.527360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.527791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.617050 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-13c33056-da33-46ef-8028-eb407603d5ee tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/action" status: 202 len: 0 microversion: 2.1 time: 0.105123 Aug 12 10:54:28.617987 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 306/579] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:54:28 2022] POST /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:54:28.627177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:28.627958 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:28.639300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.640881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.641569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.642536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.642997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.643474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.812355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:28.813666 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:28.825361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.825872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.827417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.832673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:28.833395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:28.833886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:28.922638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:28.935300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ff0fa565-09f5-4993-bc7e-e58d541bfa20 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1723 microversion: 2.1 time: 0.313272 Aug 12 10:54:28.948301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 274/580] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:28 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:29.026549 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:29.034985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8f86122c-af3e-45e7-bbbc-172d95a9da7e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.226944 Aug 12 10:54:29.035923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 307/581] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:28 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:29.413777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:29.414718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:29.426923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:29.432739 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:29.433348 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:29.433878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:29.434680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:29.435228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:29.435853 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:29.636019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:29.647441 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bbe84ef6-6afa-484a-a049-1fdd99858b7b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.238474 Aug 12 10:54:29.662368 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 275/582] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:29 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:29.920761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd", "tag": "f54409a6-4171-4222-8566-4a1a55d5800a"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:29.934262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:29.934875 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:29.935711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:29.950372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] Creating event network-changed:f54409a6-4171-4222-8566-4a1a55d5800a for instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd on hv-cinder-85294 Aug 12 10:54:29.961175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:29.962639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:29.967131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-1b21c285-5518-44da-99ea-d5b15b42e936 req-5a39d874-dd10-4a09-a66f-e7f7b252bf34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050469 Aug 12 10:54:29.970771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:29.971538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 308/583] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:29.972086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:29.972656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:29.973466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:29.974024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:29.974567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.057475 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:30.058862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:30.067871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.068643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.069376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.070683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.071422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.072016 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.193763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:30.205282 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5d4301fa-a0aa-43a2-b4c1-24be0668feff tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1723 microversion: 2.1 time: 0.248273 Aug 12 10:54:30.206252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 276/584] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:29 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:30.211210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1776652398"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:30.211858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:30.221517 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.222148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.222805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.223665 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.224322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.225080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.239873 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:30.281921 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:30.290202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-afd24988-031c-4052-a1b0-d0dc3e3c1f97 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.238078 Aug 12 10:54:30.290912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 309/585] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:30 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:30.377942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.network.security_group_api [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Adding security group 39b1cd2d-9fc0-4256-9f6e-1282a83da651 to port e484be44-9101-4901-960d-8ef8e89f6800 Aug 12 10:54:30.671000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:30.671957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:30.678788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.679263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.679858 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.680925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.681632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.682042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.721353 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-04ad7345-38ca-4e83-9242-de61a7cde7ec tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action" status: 202 len: 0 microversion: 2.1 time: 0.513493 Aug 12 10:54:30.726258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 277/586] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:54:30 2022] POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:54:30.734158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:30.746337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.747160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.747730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.761013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] Creating event network-changed:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:54:30.767170 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-63b12345-8d4f-4550-ac11-d2f2acd32faf req-6341045f-643f-4ddb-9aae-e34771d59ac9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039433 Aug 12 10:54:30.767908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 278/587] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:30.774357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:30.775650 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:30.783119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.783698 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.784201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:30.785031 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:30.785553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:30.786045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:31.119956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=4 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:31.232518 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:31.240538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ca01920a-4640-48b3-a793-9011616ba50b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.573878 Aug 12 10:54:31.241286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 310/588] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:30 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:31.245895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:31.246658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:31.253464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:31.254254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:31.254896 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:31.255875 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:31.256560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:31.257493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:31.258990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:31.267935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d831c0a7-90e2-4b53-9caf-f4ffeaa2b0e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1758 microversion: 2.1 time: 0.498520 Aug 12 10:54:31.273032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 279/589] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:30 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1758 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:31.313178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:31.313920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:31.318848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=8 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:31.320881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:31.321419 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:31.321880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:31.322778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:31.323416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:31.323844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:31.421237 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:31.447546 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:31.456509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6dee5bde-3fe3-42b4-87f7-1a8416e04043 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1723 microversion: 2.1 time: 0.213936 Aug 12 10:54:31.457361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 311/590] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:31 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:31.496336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:31.504236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0064bc27-35da-4482-989c-75a2eb56d96f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.195073 Aug 12 10:54:31.504825 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 280/591] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:31 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:32.000333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df47fd0a-3b8e-455b-9302-3f965672841c", "tag": "807c08e2-d21a-4e62-9fbc-8381f80cc0bd"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:32.005129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=12 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:32.012368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.012934 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.013452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.025696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] Creating event network-changed:807c08e2-d21a-4e62-9fbc-8381f80cc0bd for instance df47fd0a-3b8e-455b-9302-3f965672841c on hv-cinder-85294 Aug 12 10:54:32.030691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-57cf2bf6-9e91-4503-927f-8386a043ca55 req-b2e5a09e-44ae-411e-acec-dede99b15142 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035376 Aug 12 10:54:32.031314 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 312/592] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:32.266434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:32.266999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:32.273857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.274344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.274774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.275459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.275910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.276364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.416709 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:32.424134 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c0e3ec0e-48d5-45fe-aa42-669ff2da71bf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.163514 Aug 12 10:54:32.424722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 281/593] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:32 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:32.478292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:32.479060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:32.486495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.487050 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.487487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.488199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.488675 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.489084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.524485 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:32.525100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:32.531837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.532355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.532798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.533503 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:32.533961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:32.534419 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:32.675309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:32.683561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bb4e6dec-99bf-4f8a-90ac-3fa29dda55f9 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1723 microversion: 2.1 time: 0.209585 Aug 12 10:54:32.684110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 313/594] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:32 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:54:32.710798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:32.718819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-abdcb547-6654-4eb7-8b7e-be7ca7cc8cce tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.198515 Aug 12 10:54:32.719397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 282/595] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:32 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:33.448202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:33.449182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:33.458886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.459623 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.460323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.461385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.462082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.462730 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.468616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:33.613806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:33.621536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9aaa4d41-a621-4edf-82da-a668370350bb tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.179309 Aug 12 10:54:33.622085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 314/596] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:33 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:33.708677 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:33.709265 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:33.716203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.716805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.717371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.718099 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.718561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.718988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.739558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:33.740155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:33.747345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.747827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.748254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.749117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.749571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.749991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.916035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:33.924443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-582e9036-cada-4a06-8a80-81d12f7bfb9c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1729 microversion: 2.1 time: 0.219773 Aug 12 10:54:33.925020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 283/597] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:33 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:33.928641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:33.936325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d59d02f8-85bb-4ca7-953b-92ffe40be3e5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.200605 Aug 12 10:54:33.936813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 315/598] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:33 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:33.944544 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:33.945150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:33.951208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.951922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.952400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:33.953109 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:33.953642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:33.954075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:34.033724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d3aa8bd0-12ee-4a51-a7e1-e41777b8fc4f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092659 Aug 12 10:54:34.034513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 284/599] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:54:33 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:34.642892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:34.643617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:34.650597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:34.651208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:34.651662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:34.652520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:34.652905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:34.653441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:34.875984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:34.884244 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e0dfe88a-dc09-47d8-a11d-88864d6367e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.245118 Aug 12 10:54:34.896832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 316/600] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:34 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:34.957805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:34.958397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:34.964514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:34.965003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:34.965447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:34.966144 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:34.966611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:34.967104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:35.074028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:35.084490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:35.085054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:35.085556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:35.097870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] Creating event network-changed:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:54:35.102850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-02a36706-18af-4f2a-a2f9-8c0f3dad8b66 req-ef9d952b-68bb-42d0-9392-692f13eeda52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032817 Aug 12 10:54:35.103813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 317/601] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:35.154742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:35.162472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-61e28618-a552-4670-a6f7-915d4f0184bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.209286 Aug 12 10:54:35.163044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 285/602] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:34 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:35.911148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:35.915482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:35.918793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:35.924217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:35.924848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:35.930043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:35.930951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:35.931513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:35.932047 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:36.100592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:36.112759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-80a4500c-9b67-4482-8107-bd79c34dddfa tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.209056 Aug 12 10:54:36.116324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 318/603] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:35 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:36.183886 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:36.184835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:36.192736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:36.193977 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:36.194518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:36.195305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:36.195828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:36.196505 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:36.354250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:36.363540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-98102629-50ef-4489-9aaa-ca7b9e0c0970 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.184207 Aug 12 10:54:36.377092 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 286/604] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:36 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:37.125365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:37.136350 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:37.136874 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:37.139615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:37.140090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:37.140631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:37.143636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:37.144350 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:37.145403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:37.145765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:37.145885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:37.146653 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:37.153413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] Creating event network-changed:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:54:37.158473 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-d18506cc-d0a7-4c9b-bb38-6ff44631538c req-46177309-0750-42de-a3da-516a7f9e7d3a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038079 Aug 12 10:54:37.159091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 319/605] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:37.288647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:37.296489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f73eca48-9858-407a-a8cc-85dfba75d998 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.164044 Aug 12 10:54:37.297064 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 287/606] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:37 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:37.387003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:37.387643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:37.394935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:37.395438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:37.395900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:37.396963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:37.397413 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:37.397837 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:37.540217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:37.548477 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-826621df-cab6-4a7e-8fb9-936e440afa4e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.165976 Aug 12 10:54:37.549039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 320/607] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:37 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:38.320937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:38.321965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:38.334091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:38.334604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:38.335035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:38.335797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:38.336663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:38.336777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:38.495142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:38.503094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1c1679f6-9e8a-4917-a36d-942e775c6bc9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.188734 Aug 12 10:54:38.503681 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 288/608] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:38 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:38.577533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:38.578070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:38.584575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:38.585060 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:38.585499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:38.586221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:38.586672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:38.587096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:38.742295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:38.750223 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7ee96dfe-8c37-43cc-9fec-096ddbde0abd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.177427 Aug 12 10:54:38.750755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 321/609] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:38 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:39.529469 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:39.530570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:39.537176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:39.537660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:39.538085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:39.538771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:39.539217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:39.539636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:39.682777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:39.690721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-63555eee-48e1-424d-a6d8-3dd4deab9a31 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.167859 Aug 12 10:54:39.691290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 289/610] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:39 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:39.771961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:39.772606 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:39.778993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:39.779435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:39.779870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:39.780700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:39.781086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:39.781477 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:39.925911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:39.933339 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d45a6a8f-80c6-443e-8186-bebd36d0b0bc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1278 microversion: 2.1 time: 0.165679 Aug 12 10:54:39.933899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 322/611] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:39 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:40.714983 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:40.715573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:40.723435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:40.724015 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:40.724452 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:40.725306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:40.725612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:40.726255 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:40.843055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd", "name": "network-vif-plugged", "status": "completed", "tag": "f54409a6-4171-4222-8566-4a1a55d5800a"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:40.853447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:40.854445 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:40.855087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:40.867480 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] Creating event network-vif-plugged:f54409a6-4171-4222-8566-4a1a55d5800a for instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd on hv-cinder-85294 Aug 12 10:54:40.874043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-132eaaa7-0a2d-40e5-b4b8-355e24a47b39 req-e67319da-0c3b-405d-93a2-5c6df2bca98c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034417 Aug 12 10:54:40.876025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 323/612] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:40.882155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:40.890826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d7a9583f-e540-4500-be2e-e18a24bd7769 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.182115 Aug 12 10:54:40.904810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 290/613] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:40 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:40.954315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:40.955014 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:40.961383 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:40.961873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:40.962307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:40.963080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:40.963568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:40.964064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:41.123296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:41.130943 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5fc88143-043e-4177-a4b8-90ebf23c23a1 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.180857 Aug 12 10:54:41.131553 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 324/614] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:40 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:41.915799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:41.917025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:41.925960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:41.926464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:41.926912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:41.927585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:41.928085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:41.928545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:42.065028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:42.072581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0e1232ac-09f4-4df8-a2de-67256a3ae947 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.163496 Aug 12 10:54:42.073151 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 291/615] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:41 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:42.154836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:42.155700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:42.164156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:42.164872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:42.165482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:42.166512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:42.167075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:42.167662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:42.309259 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:42.317520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2eaf4e28-b801-4a95-b56f-023e6d7b2f5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.168375 Aug 12 10:54:42.318087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 325/616] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:42 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:43.096706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:43.097365 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:43.105244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:43.105777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:43.106258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:43.107019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:43.107515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:43.107977 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:43.248061 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:43.255920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dad11210-80f1-4f7c-a34c-66b9b3753480 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.164535 Aug 12 10:54:43.256506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 292/617] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:43 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:43.340199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:43.340199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:43.346745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:43.347234 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:43.347672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:43.348403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:43.348859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:43.349284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:43.483886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:43.494760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-56460e6c-1bc6-4963-abc7-c9fcfec6ef7b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.158858 Aug 12 10:54:43.495627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 326/618] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:43 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:44.281194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:44.282210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:44.293251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:44.294055 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:44.294754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:44.295945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:44.296845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:44.297520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:44.430605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:44.438905 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-812edf88-8510-4769-aa3b-0e1a88ec7fe1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.164298 Aug 12 10:54:44.439722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 293/619] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:44 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:44.524403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:44.524996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:44.531864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:44.532350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:44.533088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:44.533801 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:44.534235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:44.534665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:44.678307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:44.686053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-39118250-bddd-4331-ac39-999000a08ab9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.166528 Aug 12 10:54:44.686623 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 327/620] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:44 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:45.462343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:45.462950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:45.471666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:45.472158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:45.472634 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:45.473335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:45.473791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:45.474223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:45.610696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:45.622901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d5d60024-13b9-4e28-835f-7dc514f0b9ae tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1366 microversion: 2.1 time: 0.166298 Aug 12 10:54:45.623688 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 294/621] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:45 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:45.708238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:45.708908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:45.715358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:45.715835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:45.716283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:45.717070 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:45.717550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:45.717970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:45.857955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:45.865841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-861cc1ba-ef1e-4645-b6d3-1078063d28f0 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.161628 Aug 12 10:54:45.866401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 328/622] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:45 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:46.645775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:46.646662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:46.653529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.654012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.654463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.655146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.655593 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.656013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.670877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=100 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:46.791983 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:46.800035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bdcad333-7a50-401f-b3f4-d55aedcd2a4d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1557 microversion: 2.1 time: 0.158334 Aug 12 10:54:46.800671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 295/623] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:46 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:46.820115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:46.820725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:46.826878 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.827372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.827810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.828560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.829016 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.829471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.886389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:46.887033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:46.893427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.893942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.894381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.895078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:46.895546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:46.895978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:46.906928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-24f959a4-6b8a-4713-8201-52485e187e97 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090682 Aug 12 10:54:46.907522 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 329/624] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:54:46 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:47.037538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:47.045121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7df414c4-edc4-460c-9dd9-41463a83d2c4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.162557 Aug 12 10:54:47.045616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 296/625] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:46 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:47.896963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd", "tag": "f54409a6-4171-4222-8566-4a1a55d5800a"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:47.906577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:47.907387 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:47.907743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:47.919233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] Creating event network-changed:f54409a6-4171-4222-8566-4a1a55d5800a for instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd on hv-cinder-85294 Aug 12 10:54:47.924486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-875ad49e-8908-49b4-ae5e-cab3d505f985 req-70e76d46-d2fd-45ed-94db-4d214d8bc7d4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031683 Aug 12 10:54:47.925075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 330/626] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:48.066739 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:48.067496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:48.074245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:48.074744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:48.075193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:48.075900 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:48.076397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:48.076826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:48.213250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:48.221137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-26a6a33d-75d3-4f08-8980-184580db4ad4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.158615 Aug 12 10:54:48.221947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 297/627] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:48 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:48.442824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:48.443396 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:48.449505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:48.450294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:48.450759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:48.451642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:48.452302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:48.452717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:48.542420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lazy-loading 'services' on Instance uuid ef286192-016a-4c27-ac92-5ebeabb797c5 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:48.621431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c96885af-5439-4d50-bad7-00ca4e4ed6ce tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5/os-volume_attachments/2a58935b-57fd-42d6-a355-42bd13d61929" status: 202 len: 0 microversion: 2.1 time: 0.183204 Aug 12 10:54:48.622021 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 331/628] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:54:48 2022] DELETE /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5/os-volume_attachments/2a58935b-57fd-42d6-a355-42bd13d61929 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:54:49.246522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:49.247578 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:49.255555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:49.256038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:49.256501 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:49.257185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:49.257639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:49.258059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:49.400209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:49.408523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2cb1fcf5-3bea-40e1-aeff-6213d068c6b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.168619 Aug 12 10:54:49.409103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 298/629] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:49 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:50.434645 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:50.435785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:50.446498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.447294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.448013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.449213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.449961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.450677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.599154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:50.607286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2dca14b0-f786-4b78-aff2-31adce9dc561 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.179913 Aug 12 10:54:50.607847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 332/630] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:50 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:50.826717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:50.827243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:50.834480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.834972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.835407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.836142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.836629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.837057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.862560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:54:50.952000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-87cc43f5-457e-47f2-8e6a-0a0299debd4c tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 204 len: 0 microversion: 2.1 time: 0.128912 Aug 12 10:54:50.952681 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 299/631] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:54:50 2022] DELETE /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:54:50.961687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:50.962291 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:50.968426 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.968933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.969379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.970077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:50.970576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:50.970998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:50.975350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:54:51.110747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:51.119324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9692d816-7f7c-4805-b781-5f1f87891925 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1513 microversion: 2.1 time: 0.161480 Aug 12 10:54:51.131976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 333/632] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:50 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:51.184427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df47fd0a-3b8e-455b-9302-3f965672841c", "name": "network-vif-plugged", "status": "completed", "tag": "807c08e2-d21a-4e62-9fbc-8381f80cc0bd"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:51.195350 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:51.196045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:51.196513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:51.210980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] Creating event network-vif-plugged:807c08e2-d21a-4e62-9fbc-8381f80cc0bd for instance df47fd0a-3b8e-455b-9302-3f965672841c on hv-cinder-85294 Aug 12 10:54:51.215994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-06b83c3d-3224-4f72-ac6b-6644b4d20bb6 req-7b213ef9-4e1e-4d7b-bc04-e32d681128e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035802 Aug 12 10:54:51.216652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 300/633] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:54:51.632243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:51.633253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:51.642860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:51.643361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:51.643753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:51.644499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:51.644945 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:51.645360 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:51.798571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:51.807232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a6e8fb34-ffc3-4635-9b99-fff9b388236c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.181951 Aug 12 10:54:51.807827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 334/634] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:51 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:52.149208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:52.150345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:52.159804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:52.160331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:52.160838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:52.161533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:52.161991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:52.162414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:52.306545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:52.314442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e958d6f4-8497-427f-9a5e-d2dc28207737 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1513 microversion: 2.1 time: 0.174026 Aug 12 10:54:52.315033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 301/635] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:52 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1513 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:52.829363 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:52.830861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:52.836901 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:52.837383 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:52.837814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:52.838497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:52.838947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:52.839422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:52.982830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:52.990791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c5f3ec51-1e23-4638-8ca7-76f13c11f0cc tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.165610 Aug 12 10:54:52.991353 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 335/636] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:52 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:53.336292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:53.336919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:53.344448 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:53.344945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:53.345370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:53.346836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:53.347290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:53.347939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:53.481490 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:53.489889 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5ff97a0f-5076-43c9-a70f-f70a3f836ab0 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1513 microversion: 2.1 time: 0.157511 Aug 12 10:54:53.490457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 302/637] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:53 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:54.012828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:54.013498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:54.020297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.020829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.021264 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.022290 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.022769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.023213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.033594 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef286192-016a-4c27-ac92-5ebeabb797c5", "name": "network-vif-deleted", "tag": "39fe8d64-c46a-4681-b204-b2d38747327b"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:54.042988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.043476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.043896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.054993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] Creating event network-vif-deleted:39fe8d64-c46a-4681-b204-b2d38747327b for instance ef286192-016a-4c27-ac92-5ebeabb797c5 on hv-cinder-85294 Aug 12 10:54:54.059892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-76305eb3-0771-49a9-bca7-c189d86b6bcc req-fac420be-440e-4db6-9918-b2889e75d24f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030068 Aug 12 10:54:54.060516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 303/638] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:54:54.157711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:54.165734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-82581069-6a84-449c-ac76-252cfa6b19d6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1266 microversion: 2.1 time: 0.157212 Aug 12 10:54:54.166299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 336/639] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:54 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:54.512012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:54.512734 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:54.519594 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.520160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.520516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.521203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.521964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.522382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.554009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:54.554494 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:54.554924 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:54.555386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lazy-loading 'fault' on Instance uuid ef286192-016a-4c27-ac92-5ebeabb797c5 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:54.610086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:54.618428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-75985878-ae45-4bf0-abae-6d9e50a26859 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1308 microversion: 2.1 time: 0.110644 Aug 12 10:54:54.619005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 304/640] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:54 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1308 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:55.246960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:55.247516 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:55.254677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.255165 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.255728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.256559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.257011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.257428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.399101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:55.406984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-964c2061-cd4c-4bcd-a13b-fa59897823fa tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1452 microversion: 2.1 time: 0.164950 Aug 12 10:54:55.407577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 337/641] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:55 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:55.430911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:55.431875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:55.441576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.442334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.443030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.444146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.444931 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.445582 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.584636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:55.595836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3ec03fea-61e4-4fcc-a537-6928edf6fb7f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1452 microversion: 2.1 time: 0.171358 Aug 12 10:54:55.597174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 305/642] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:55 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:55.639725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:55.640365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:55.647691 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.648175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.648641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.649339 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.649783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.650204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.682197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:55.682669 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:55.683105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:55.683556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lazy-loading 'fault' on Instance uuid ef286192-016a-4c27-ac92-5ebeabb797c5 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:54:55.729993 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bd68057dba244cabdb8efe86ee31b7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce501b5e17df4518a2ec76763bc3d81e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:54:55.737757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f0f2c407-c6c8-41a7-8016-bcf9a9f15755 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 200 len: 1308 microversion: 2.1 time: 0.101866 Aug 12 10:54:55.738362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 338/643] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:55 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:54:56.759206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:54:56.760048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] [instance: ef286192-016a-4c27-ac92-5ebeabb797c5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:54:56.767177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:56.767663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:56.768139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:56.768882 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:56.769335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:56.769758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:56.785037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] HTTP exception thrown: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Request method failure captured: Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 HTTP/1.1 Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jDbQSd_EISndfRPFcf5TmgfFo3hvYMgzUYb759v71lNAiAk5AK9DCIVN4NJMetj3lEIaDXDeTVQcNadcaDFpJOR15omtoJiEm59Rp5jZ-SdVNptle7woodHSJK9PZdd89NhCGKi3iV6cDUGTIgV9_Lvy4ro_R35FEBaONXaWcedTdY Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: ce501b5e17df4518a2ec76763bc3d81e Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:54:56.787383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_ce501b5e17df4518a2ec76763bc3d81e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/ce501b5e17df4518a2ec76763bc3d81e"}]}] Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: ce501b5e17df4518a2ec76763bc3d81e Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1902145617 Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-VolumesSnapshotTestJSON-1902145617-project Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 7bd68057dba244cabdb8efe86ee31b7e Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-VolumesSnapshotTestJSON-1902145617-project Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. Aug 12 10:54:56.788839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'ef286192-016a-4c27-ac92-5ebeabb797c5'} Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:54:56.789879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. Aug 12 10:54:56.791362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:54:56.793171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] Returning 404 to user: Instance ef286192-016a-4c27-ac92-5ebeabb797c5 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:54:56.793171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a2215119-1cc6-4081-8d44-20094e20a9b3 tempest-VolumesSnapshotTestJSON-1902145617 tempest-VolumesSnapshotTestJSON-1902145617-project] 10.222.0.23 "GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5" status: 404 len: 111 microversion: 2.1 time: 0.033564 Aug 12 10:54:56.793171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 306/644] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:54:56 2022] GET /compute/v2.1/servers/ef286192-016a-4c27-ac92-5ebeabb797c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:54:57.578581 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df47fd0a-3b8e-455b-9302-3f965672841c", "tag": "807c08e2-d21a-4e62-9fbc-8381f80cc0bd"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:54:57.588176 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:54:57.588787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:54:57.589238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:54:57.601149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] Creating event network-changed:807c08e2-d21a-4e62-9fbc-8381f80cc0bd for instance df47fd0a-3b8e-455b-9302-3f965672841c on hv-cinder-85294 Aug 12 10:54:57.606582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-06929613-edc7-45b1-a1d3-0938cd24441f req-3a457af7-3f58-4e31-9792-ce0f8d733c46 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Aug 12 10:54:57.607190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 339/645] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:06.573532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:06.574254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:06.578887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:06.583000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.583561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.584117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.584944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.585410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.585836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.616187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-498eda9e-0301-4cd6-81d5-8b6bddccbbf7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments/ff140c3f-f53a-4313-b235-cd0f40773019" status: 200 len: 194 microversion: 2.20 time: 0.046777 Aug 12 10:55:06.616701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 307/646] 10.222.0.23 () {60 vars in 1454 bytes} [Fri Aug 12 10:55:06 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments/ff140c3f-f53a-4313-b235-cd0f40773019 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:06.694697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:06.695351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:06.697359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=46 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:06.702902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.703381 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.703810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.704657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.705100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.705514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.791338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lazy-loading 'services' on Instance uuid 8c63996f-78ad-46b1-8b3b-3fb94a73556a {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:06.875828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3eec0b73-f400-4477-a515-c10b9aa4c73e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments/ff140c3f-f53a-4313-b235-cd0f40773019" status: 202 len: 0 microversion: 2.20 time: 0.185661 Aug 12 10:55:06.876587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 340/647] 10.222.0.23 () {60 vars in 1457 bytes} [Fri Aug 12 10:55:06 2022] DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments/ff140c3f-f53a-4313-b235-cd0f40773019 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:55:06.885092 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:06.887269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:06.893294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.893776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.894244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.894946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:06.895404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:06.895828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:06.925474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-345927db-efbd-40e2-9987-4101f80c3433 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044374 Aug 12 10:55:06.926027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 308/648] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:55:06 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:07.942336 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:07.945605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:07.955667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:07.956148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:07.956612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:07.957299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:07.957740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:07.958155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:07.988645 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6603038f-dcf1-466c-856d-f00bcc289eaf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053080 Aug 12 10:55:07.989182 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 341/649] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:55:07 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:09.004486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:09.006928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:09.014547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:09.015254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:09.015752 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:09.016572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:09.017083 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:09.017564 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:09.050453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ac521145-c875-42aa-b824-298fbec466e4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050696 Aug 12 10:55:09.051023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 309/650] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:55:08 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:10.067489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:10.070509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:10.080206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:10.080720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:10.081190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:10.081875 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:10.082319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:10.082745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:10.113643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-16a8f79c-8520-4b31-8a2c-855403da269d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052961 Aug 12 10:55:10.114197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 342/651] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:55:10 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:11.129307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:11.132643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:11.142105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.142600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.143033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.143724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.144175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.144628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.177057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-aa54e290-a760-45d0-ba86-8c221613ffbb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054061 Aug 12 10:55:11.177658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 310/652] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:55:11 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:11.240177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:11.240761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:11.246933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.247419 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.247851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.248566 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.249015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.249429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.275818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:55:11.359487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-34c78676-cc95-4aa0-97e3-76d63264365b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 204 len: 0 microversion: 2.20 time: 0.123768 Aug 12 10:55:11.360555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 343/653] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Aug 12 10:55:11 2022] DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 10:55:11.369490 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:11.370150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:11.377004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.377492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.377998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.378707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:11.379165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:11.379596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:11.517669 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:11.526292 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:11.527789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:11.529011 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-58507077-ad4f-4207-8ac2-4cdcc3e081c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.163652 Aug 12 10:55:11.529780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 311/654] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:11 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:12.153181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:12.158234 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:12.164806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.165248 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.168786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.169514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.169973 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.170394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.244868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-23ccf7f2-4e03-4b49-baa0-1c36796dc6d1 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action" status: 202 len: 0 microversion: 2.1 time: 0.097065 Aug 12 10:55:12.245395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 344/655] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:55:12 2022] POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:55:12.254252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:12.254906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:12.261386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.261991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.262420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.263112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.263561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.263981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.268411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:12.485390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:12.495357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-63ce72f8-6fe2-465a-a447-ee88c911d4cc tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1750 microversion: 2.1 time: 0.245456 Aug 12 10:55:12.495960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 312/656] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:12 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1750 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:12.560236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:12.560935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:12.567560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.568093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.568526 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.569335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:12.569820 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:12.570285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:12.718005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:12.726199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:12.727690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:12.728888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a3c58335-a4bf-4361-9875-402dc26cfa68 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.173102 Aug 12 10:55:12.729468 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 345/657] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:12 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:13.519820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:13.520585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:13.527105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:13.527602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:13.528059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:13.528796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:13.529247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:13.529667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:13.683607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:13.692000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ace8b11c-5624-4fb6-98ef-222b5a147c1e tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1750 microversion: 2.1 time: 0.176716 Aug 12 10:55:13.692668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 313/658] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:13 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1750 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:13.751255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:13.751859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:13.759233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:13.759728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:13.760156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:13.760966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:13.761420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:13.761827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:13.957342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:13.961020 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:13.967185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:13.968717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:13.969871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1921be59-25f6-4af3-aac4-c4271073224d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1725 microversion: 2.20 time: 0.222649 Aug 12 10:55:13.970430 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 346/659] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:13 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:14.688748 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63996f-78ad-46b1-8b3b-3fb94a73556a", "name": "network-vif-deleted", "tag": "2f363aef-5fdf-4c5d-8b23-5da876befc44"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:14.706014 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:14.707024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:14.707270 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:14.713970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:14.715812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:14.720028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] Creating event network-vif-deleted:2f363aef-5fdf-4c5d-8b23-5da876befc44 for instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a on hv-cinder-85294 Aug 12 10:55:14.724584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:14.725123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:14.725800 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:14.726504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-aa142bd0-1425-4820-8d39-34ab3cc74cd0 req-25093193-11d5-4321-96ec-dcb8dd17e0d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041113 Aug 12 10:55:14.726633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:14.727036 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:14.727476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:14.728172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 314/660] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:14.904531 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:14.916703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2e04540d-396f-4be7-8d8a-c6de4ea61106 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.206347 Aug 12 10:55:14.917794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 347/661] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:14 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:14.996572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:14.997202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:15.003863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:15.004412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:15.004854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:15.005710 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:15.006106 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:15.006626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:15.039680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:15.040169 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:15.040641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:15.041090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lazy-loading 'fault' on Instance uuid 8c63996f-78ad-46b1-8b3b-3fb94a73556a {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:15.087194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:15.095267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:15.096888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:15.098071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-095d1115-d2a7-4e31-9e46-7e03c720de9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 200 len: 1371 microversion: 2.20 time: 0.108419 Aug 12 10:55:15.098609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 315/662] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:14 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:15.942617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:15.943282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:15.949282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:15.949767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:15.950206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:15.950892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:15.951344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:15.951764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:16.102776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:16.111432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-51cc1558-0173-4dbc-921c-38ebb6e0525c tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.173736 Aug 12 10:55:16.112005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 348/663] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:15 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:16.120920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:16.121498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:16.128126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:16.128645 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:16.129077 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:16.129768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:16.130218 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:16.130641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:16.144763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a HTTP/1.1 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:55:16.146474 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:55:16.148392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '8c63996f-78ad-46b1-8b3b-3fb94a73556a'} Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:16.149339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:55:16.151216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:16.152742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:16.152742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2152cd13-f20b-41d1-b64a-c1591ce55745 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 404 len: 111 microversion: 2.20 time: 0.031268 Aug 12 10:55:16.152742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 316/664] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:16 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:55:16.162163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-09faaa47-2597-4c39-8bcd-bb2dbb7faf3c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '.version_select at 0x7efc5cb0fa60>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:16.187955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-09faaa47-2597-4c39-8bcd-bb2dbb7faf3c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792543490" status: 204 len: 0 microversion: 2.20 time: 0.032659 Aug 12 10:55:16.188530 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 349/665] 10.222.0.23 () {60 vars in 1262 bytes} [Fri Aug 12 10:55:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792543490 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 10:55:16.890299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9579a03b-32b3-48a5-b075-c9609e7f477b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: .version_select at 0x7efc5c914310>, body: {"keypair": {"name": "tempest-keypair-931051763", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ435F7+RnC8jKTEp4mklYSuPVQeWMdRsCT9yMtOPdrOcWKFOpVH0G7N0e01katI5p/AWvK5NeEzcpKpIBOp/mgk9AJotlc53r65OyqF8botun32pqqw/s1YnOZvTWRpg=="}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:16.906366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9579a03b-32b3-48a5-b075-c9609e7f477b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:55:16.910672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9579a03b-32b3-48a5-b075-c9609e7f477b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for user c0711a144b4c4432ab849367d3bd2b33 and project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'key_pairs'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:55:16.934101 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9579a03b-32b3-48a5-b075-c9609e7f477b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047767 Aug 12 10:55:16.934658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 317/666] 10.222.0.23 () {62 vars in 1200 bytes} [Fri Aug 12 10:55:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 12 10:55:17.133466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:17.134107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:17.141334 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:17.142334 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:17.142774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:17.143927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:17.144711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:17.145141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:17.327033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:17.335517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9ae4a045-c471-4d4e-8b91-c6274574b7ee tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.206508 Aug 12 10:55:17.336091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 350/667] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:17 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:18.328536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2060866513", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76f15494-8bf4-43ef-9f7b-d0448450839d"}], "security_groups": [{"name": "tempest-securitygroup--13996595"}], "key_name": "tempest-keypair-931051763", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:18.356845 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:18.358071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:18.365011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:18.365544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:18.366006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:18.366715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:18.367476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:18.368205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:18.472989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] validate_networks() for [('76f15494-8bf4-43ef-9f7b-d0448450839d', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:55:18.619940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:18.628565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a3824820-eda0-4f79-9bee-2347723008ed tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.275548 Aug 12 10:55:18.629134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 351/668] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:18 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:18.898470 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:55:18.899079 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:55:18.899714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:55:18.900329 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:55:18.900912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:55:18.913455 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:18.913935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:18.914372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:18.915115 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:18.915566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:18.915994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:18.933045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:55:18.937215 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Getting quotas for user c0711a144b4c4432ab849367d3bd2b33 and project 1d3cc44ffed94a428ab9e49ebb3854e0. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:55:18.948942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:55:18.951196 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:55:19.000200 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-465a6755-bbf7-420e-9603-7b16500957a1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.676415 Aug 12 10:55:19.000912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 318/669] 10.222.0.23 () {62 vars in 1188 bytes} [Fri Aug 12 10:55:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 12 10:55:19.012157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:19.012790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:19.071731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:19.079210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:19.080907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:19.082216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f03cc581-f272-445a-a979-26e38c171b89 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1281 microversion: 2.20 time: 0.074141 Aug 12 10:55:19.082771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 352/670] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:19 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:19.650776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:19.651533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:19.657662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:19.658130 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:19.658561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:19.659712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:19.660826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:19.661403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:19.817544 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:19.825919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-982acb1e-3df8-4a23-b981-76372d0c7f47 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.180007 Aug 12 10:55:19.826499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 319/671] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:19 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:20.108587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:20.109507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:20.121554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:20.122321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:20.123085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:20.124233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:20.125022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:20.125723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:20.191158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:20.199846 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:20.201375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:20.202510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4d32f9bb-2a81-4858-a541-e576d22e11c0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1333 microversion: 2.20 time: 0.100580 Aug 12 10:55:20.203039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 353/672] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:20 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1333 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:20.846835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:20.847525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:20.860526 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:20.861028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:20.861454 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:20.862276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:20.862597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:20.863447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:21.024383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:21.037974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cab0b25b-c1fb-4cb1-941c-ae7f07cf49be tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.194864 Aug 12 10:55:21.043992 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 320/673] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:20 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:21.231951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:21.235259 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:21.254338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:21.254836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:21.255260 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:21.256174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:21.256652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:21.257091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:21.410704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:21.419838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:21.421467 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:21.422701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6c74b2bc-19c2-4800-843d-1043fa9c4f54 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.200389 Aug 12 10:55:21.423276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 354/674] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:21 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:21.862220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:21.874063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:21.874586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:21.875018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:21.889942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] Creating event network-changed:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:55:21.896575 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-abe905bb-0af3-4bbf-ac9e-de29606862f2 req-e687c692-1b63-4cc5-a57c-fba545b3f14c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039205 Aug 12 10:55:21.898237 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 321/675] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:22.061212 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:22.061874 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:22.069584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:22.070088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:22.070512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:22.071217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:22.071754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:22.072288 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:22.260436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:22.272672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f4cb56c4-e2ab-4872-a890-f161c6de2941 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.215757 Aug 12 10:55:22.280306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 355/676] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:22 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:22.448813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:22.450053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:22.457678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:22.458192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:22.458632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:22.459357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:22.459822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:22.460254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:22.659994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:22.669805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:22.671325 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:22.672498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-007ebe37-a1c6-4a67-a841-63ec0ea01c6d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.229223 Aug 12 10:55:22.673110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 322/677] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:22 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 12 10:55:23.294733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:23.295409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:23.302076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:23.302559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:23.302986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:23.303682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:23.304152 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:23.304603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:23.453554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:23.463083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-951da392-4579-4214-8dfd-fb4725138369 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.172506 Aug 12 10:55:23.463635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 356/678] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:23 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:23.697136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:23.697758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:23.704830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:23.705350 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:23.705975 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:23.706722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:23.707331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:23.707985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:23.853728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:23.862158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:23.863734 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:23.865065 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0e5ebaf0-2cb7-49ae-98ae-5a293baf85af tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.171855 Aug 12 10:55:23.865668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 323/679] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:23 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:24.487807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:24.488641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:24.496538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:24.497143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:24.497679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:24.498552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:24.499045 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:24.499550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:24.657188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:24.666452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6ddd94f9-11c6-4024-b4de-4d9d3f5640b3 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.184708 Aug 12 10:55:24.667010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 357/680] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:24 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:24.892233 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:24.893303 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:24.904116 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:24.905020 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:24.905631 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:24.906727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:24.907476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:24.908160 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.042909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:25.051125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:25.052704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:25.053845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-99f5ddd5-c15a-41dd-8143-e88555721d83 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.167968 Aug 12 10:55:25.054414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 324/681] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:24 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:25.688888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:25.689491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:25.696040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.696502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.696917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.697640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.698088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.698498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.699600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:25.700115 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:25.706605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.707124 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.707860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.709213 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.709682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.710112 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.797221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'services' on Instance uuid 880e761f-5cfb-427d-a5fd-07f00959ba78 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:25.850157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:25.859440 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d0e87d6e-1b6b-419e-971a-cead90dee37d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.174416 Aug 12 10:55:25.859991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 358/682] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:25 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:25.874056 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d5db995d-ac10-49ac-8414-e20445cbe4c0 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments/c510ebd4-711b-4e2c-ac4c-187934ebdce8" status: 202 len: 0 microversion: 2.1 time: 0.178231 Aug 12 10:55:25.874703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 325/683] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:55:25 2022] DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments/c510ebd4-711b-4e2c-ac4c-187934ebdce8 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:55:25.884097 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:25.886375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:25.892610 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.893101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.893535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.894230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:25.894724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:25.895154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:25.924459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6a561d68-01dc-426d-802c-f148e75d3c50 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 Aug 12 10:55:25.925002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 359/684] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:25 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:26.080995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:26.081919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:26.092053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.092576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.093009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.093704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.094163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.094583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.231841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:26.244939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:26.247351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:26.249162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-66b6fb2b-0ded-4ab7-a66a-5442d2b3ea01 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.175321 Aug 12 10:55:26.249906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 326/685] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:26 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:26.884869 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:26.886747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:26.895087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.895887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.896584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.897883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.900341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.900946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.938992 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:26.942117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:26.951344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.952178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.953533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.954643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:26.955652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:26.956119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:26.995128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-53206d8f-58de-491f-9195-0f2072710d96 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062493 Aug 12 10:55:26.996227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 327/686] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:26 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:55:27.092784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:27.103015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7f06ad8f-3514-48ce-b58e-f26579ea0b9d tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.224403 Aug 12 10:55:27.103795 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 360/687] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:26 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:27.274842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:27.275425 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:27.282264 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:27.282741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:27.283178 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:27.283866 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:27.284340 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:27.284763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:27.424699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:27.432957 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:27.434449 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:27.435560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a046065e-42b4-4a99-9750-df4da82975d7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.165417 Aug 12 10:55:27.436117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 328/688] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:27 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:28.013300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:28.017171 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:28.025832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.026484 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.027131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.028189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.028913 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.029560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.063798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0daf4a18-7b71-452d-8be4-03c14dc3f648 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058270 Aug 12 10:55:28.064451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 361/689] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:28 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:28.129103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:28.130057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:28.139589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.140423 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.141136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.142230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.142955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.143640 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.294770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:28.306908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c2c796cd-acff-4dc4-8396-18a998116a9a tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.184153 Aug 12 10:55:28.307641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 329/690] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:28 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:28.461912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:28.462857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:28.473279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.474159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.474620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.475315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:28.475842 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:28.476298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:28.621813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:28.630019 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:28.631792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:28.632918 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-66c58d62-7db9-41b9-ba77-3affbf6fd095 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.177574 Aug 12 10:55:28.633493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 362/691] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:28 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:29.081547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:29.084897 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:29.087790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:29.088876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=10 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:29.097094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.097818 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.098447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.099580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.100037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.100565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.133964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-50972664-d9b6-4e50-89c3-64f412575838 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058306 Aug 12 10:55:29.134532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 330/692] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:29 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:29.335686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:29.336348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:29.338574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:29.345035 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.345596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.346120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.346931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.347454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.347943 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.498512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:29.510279 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d3f68b4b-f975-41a5-bdc5-46e262bce6ae tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.180483 Aug 12 10:55:29.511030 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 363/693] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:29 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:29.660201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:29.661277 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:29.672078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.672950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.673714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.674823 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:29.675576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:29.676338 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:29.691755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:29.825599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:29.838902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:29.841220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:29.842950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dd11efef-73f4-43fd-b050-1b900055cb90 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.189212 Aug 12 10:55:29.843777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 331/694] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:29 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:30.152486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:30.156244 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:30.164903 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.165387 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.165844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.166514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.166965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.167397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.198957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d538ff8d-8add-4324-9554-f6f6d4bdbdb6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054642 Aug 12 10:55:30.199504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 364/695] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:30 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:30.532926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:30.533531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:30.540279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.540792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.541198 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.541891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.542362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.542785 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.690653 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:30.698826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-abab9318-d01b-4839-baea-51e6cd3fd5da tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.169798 Aug 12 10:55:30.699403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 332/696] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:30 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:30.867409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:30.868011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:30.874483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.874827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.875571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.875902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:30.876392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:30.876808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:30.897352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=100 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:31.020390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:31.029455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:31.031154 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:31.032452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9b3cde50-6c59-49b0-b056-08ff7dc2eed1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.169030 Aug 12 10:55:31.033115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 365/697] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:30 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:31.085432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "name": "network-vif-plugged", "status": "completed", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:31.098978 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.099692 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.100308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.112456 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] Creating event network-vif-plugged:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:55:31.118312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-5fac8c9a-c16e-4291-b20c-b9458fbb2243 req-16482820-d63b-46fe-a9ef-8819a78ccfad service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038194 Aug 12 10:55:31.119545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 333/698] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:31.212582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:31.214899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:31.221075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.221571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.222022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.222724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.223203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.223624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.255774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e1859c6c-b62d-481d-9c13-727ee2af4bd6 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047763 Aug 12 10:55:31.261720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 366/699] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:31 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 12 10:55:31.349304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:31.350158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:31.356682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.357320 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.357956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.358766 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.359289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.359783 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.388408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:55:31.507070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-65a34c65-8dd8-4348-8f26-4cc85c4d0c8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 204 len: 0 microversion: 2.1 time: 0.156173 Aug 12 10:55:31.507070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 334/700] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:55:31 2022] DELETE /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:55:31.511763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:31.512415 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:31.518547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.519025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.519481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.520246 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.521098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.521589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.661561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:31.669354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e9567f39-0e18-40e8-8506-c64663cd7f8a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.161626 Aug 12 10:55:31.669915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 367/701] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:31 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:31.721714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:31.722418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:31.729565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.730064 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.730508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.731221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:31.731679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:31.732094 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:31.879921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:31.891590 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e91c949e-95b0-4a0f-a13f-bcf5d5b05a63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.173858 Aug 12 10:55:31.892512 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 335/702] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:31 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:32.060633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:32.061548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:32.072565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.073366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.073834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:32.074732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.075446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.076104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:32.224989 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:32.233642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:32.235118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:32.236206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f90aa10d-dd9f-4464-a4d7-1d0325f730e2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.184107 Aug 12 10:55:32.236794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 368/703] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:32 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:32.692778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:32.693472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:32.699944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.700445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.700879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:32.701568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.702014 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.702438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:32.835676 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:32.845093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-72aa875a-71f4-425a-8df2-20e795e6f811 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.156204 Aug 12 10:55:32.845659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 336/704] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:32 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:32.917783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:32.918584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:32.926781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.927418 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.928044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:32.929227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:32.929831 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:32.930395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:33.087508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:33.096296 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d300537f-a2c6-4cc7-b100-3abfd31dca91 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.183833 Aug 12 10:55:33.096877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 369/705] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:32 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:33.262660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:33.263642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:33.273510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:33.273918 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:33.274345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:33.275029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:33.275479 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:33.275898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:33.578128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:33.586462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:33.587946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:33.589097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8822b49e-fcc7-4730-a278-361a773bbeef tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.333220 Aug 12 10:55:33.589652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 337/706] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:33 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:33.869219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:33.869745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:33.876092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:33.876648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:33.877094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:33.877792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:33.878251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:33.878730 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:34.016140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:34.024862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-16820391-5f4f-4a70-b682-e05d6c8ec73f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.160847 Aug 12 10:55:34.025431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 370/707] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:33 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:34.122117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:34.122824 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:34.133678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:34.134480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:34.135187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:34.136373 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:34.137174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:34.137877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:34.293078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:34.305732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1c89f655-2d52-4884-a63c-34a2a3910274 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.190121 Aug 12 10:55:34.306473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 338/708] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:34 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:34.611104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:34.611696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:34.617797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:34.618343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:34.618867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:34.619747 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:34.620193 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:34.620634 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:34.754321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:34.763057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:34.764588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:34.765694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0d64cb71-07a2-41a6-b8b0-9ddf416a4f81 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.158461 Aug 12 10:55:34.766284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 371/709] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:34 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:35.045790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:35.046346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:35.052557 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.053048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.053465 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.054541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.054838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.055267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.332167 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:35.333200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:35.341832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.342351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.343232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.343953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.344980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.345514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.443876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:35.451915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0c01e011-d1d4-4394-b596-e5a59ad48154 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.410022 Aug 12 10:55:35.452525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 339/710] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:35 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:35.541064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:35.549536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-88392d21-5989-4e50-872a-adb5a872efe2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1755 microversion: 2.1 time: 0.221110 Aug 12 10:55:35.550029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 372/711] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:35 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:55:35.789759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:35.790381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:35.792441 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:35.797908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.798382 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.798812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.799496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:35.799998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:35.800398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:35.937743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:35.945908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:35.947411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:35.948555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9381c3c4-ec77-482d-9067-2311d68c5100 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1405 microversion: 2.20 time: 0.163461 Aug 12 10:55:35.949093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 340/712] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:35 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:36.476205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:36.476844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:36.483605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.484098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.484559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:36.485246 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.485696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.486108 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:36.572791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:36.573446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:36.580236 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.580806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.581299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:36.582075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.582577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.583068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:36.618127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:36.626052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c0884202-21e2-4306-9904-3e260960662d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.153935 Aug 12 10:55:36.626591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 373/713] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:36 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:36.735125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:36.743156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fd89524f-ca7a-4c59-a0eb-31156407b439 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1758 microversion: 2.1 time: 0.174230 Aug 12 10:55:36.743715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 341/714] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:36 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:55:36.975427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:36.976533 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:36.979514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:36.988174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.989012 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.989724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:36.990897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:36.991797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:36.992230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:37.129188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:37.141797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:37.144225 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:37.146166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c6758233-efb2-4827-be58-27b74994879d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1598 microversion: 2.20 time: 0.177044 Aug 12 10:55:37.147205 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 374/715] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:55:36 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1598 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:55:37.169689 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:37.170179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:37.176685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:37.177167 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:37.177603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:37.178293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:37.178830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:37.179227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:37.255648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-21b35b98-dc66-4422-adb0-978f1adc0668 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089853 Aug 12 10:55:37.256246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 342/716] 10.222.0.23 () {60 vars in 1316 bytes} [Fri Aug 12 10:55:37 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:55:37.647926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:37.648946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:37.656860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:37.657398 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:37.658276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:37.658994 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:37.659456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:37.659882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:37.914822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:37.922471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b1dd6f7d-fc20-4595-84d4-6c59204ce021 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 200 len: 1689 microversion: 2.1 time: 0.279156 Aug 12 10:55:37.923277 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 375/717] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:37 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 1689 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:38.153736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "880e761f-5cfb-427d-a5fd-07f00959ba78", "name": "network-vif-deleted", "tag": "a0ebdcd4-e65f-444c-a01e-6e9d3f635328"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:38.168591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:38.169225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:38.169875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:38.181891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] Creating event network-vif-deleted:a0ebdcd4-e65f-444c-a01e-6e9d3f635328 for instance 880e761f-5cfb-427d-a5fd-07f00959ba78 on hv-cinder-85294 Aug 12 10:55:38.188000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-6c8783bb-6990-4f73-b4a5-7a147d8a7678 req-1eb60582-ed1b-4bb1-8e04-9dd7addad9a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038789 Aug 12 10:55:38.188684 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 343/718] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:38.321351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:38.332056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:38.332839 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:38.333572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:38.353754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] Creating event network-changed:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:55:38.365799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-999e7e89-7db3-429b-8bb1-f0587123f233 req-473178a4-026d-481e-acde-718acee8d7be service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048406 Aug 12 10:55:38.366756 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 376/719] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:38.944686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:38.945462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: 880e761f-5cfb-427d-a5fd-07f00959ba78] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:38.959149 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:38.959800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:38.960406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:38.961432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:38.961947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:38.962434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:38.982405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] HTTP exception thrown: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Request method failure captured: Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 HTTP/1.1 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBxx2qKhRWtVhvGuh4sEchgFVSGUIa--BMtLwuTuBpLIUtlMsFEmoEx5LnJVmgWRKw38eDPWOit2ByMv2oo007-7Kvzos32s8GTLgK16gfwrOC0b2HaUnFROCskJU4hSxBp4fDlrw5Cyn-AvRtWWZAyBPrhRzLv72BYk2wP63FCsN0 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:55:38.984227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc63f648a390465e94ab8170362a9b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}] Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 58e209063f5c454d87d9f743bedfc734 Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. Aug 12 10:55:38.985694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '880e761f-5cfb-427d-a5fd-07f00959ba78'} Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:38.986541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. Aug 12 10:55:38.987799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:38.988952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Returning 404 to user: Instance 880e761f-5cfb-427d-a5fd-07f00959ba78 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:38.988952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bd570b03-2a1b-4700-b26b-cb5f58355f55 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78" status: 404 len: 111 microversion: 2.1 time: 0.045541 Aug 12 10:55:38.988952 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 344/720] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:38 2022] GET /compute/v2.1/servers/880e761f-5cfb-427d-a5fd-07f00959ba78 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:55:38.997690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ca0df401-ff53-4167-b6f1-6399147f268d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '.version_select at 0x7efc5cbb83a0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:39.031157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ca0df401-ff53-4167-b6f1-6399147f268d tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435640008" status: 202 len: 0 microversion: 2.1 time: 0.039032 Aug 12 10:55:39.036197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 377/721] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Aug 12 10:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435640008 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:55:42.059599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:42.060403 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:42.073273 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:42.073757 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:42.074199 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:42.074985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:42.075470 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:42.075906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:42.101129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:55:42.180971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fe74d875-21be-434c-bbaf-81aac8c9376f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 204 len: 0 microversion: 2.1 time: 0.127313 Aug 12 10:55:42.181845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 345/722] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:55:42 2022] DELETE /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:55:42.190759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:42.191483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:42.198788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:42.199280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:42.199694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:42.200446 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:42.200893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:42.201306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:42.336298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:42.348696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4c95ca1b-d4dd-4586-9617-563a2c15e317 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1507 microversion: 2.1 time: 0.161864 Aug 12 10:55:42.349265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 378/723] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:42 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:43.306358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:43.306948 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:43.313265 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:43.313707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:43.314150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:43.314844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:43.315299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:43.315728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:43.340077 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b94ee94b-cc4f-4bf4-b7a2-af9d3a8338ba tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/ips" status: 200 len: 151 microversion: 2.1 time: 0.284592 Aug 12 10:55:43.340678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 346/724] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:55:43 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/ips => generated 151 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:55:43.369534 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:43.370157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:43.376284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:43.376788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:43.377223 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:43.377976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:43.378357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:43.378782 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:43.516927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:43.525029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6ac6c6e5-5e66-41c0-976c-1868352a6ee3 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1507 microversion: 2.1 time: 0.159409 Aug 12 10:55:43.525680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 379/725] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:43 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:44.550621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:44.551639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:44.559344 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:44.559836 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:44.560304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:44.561003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:44.561458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:44.561885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:44.577269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:44.679441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae0dad67-e927-46d2-bfae-e0a6108b4441"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:44.681836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:44.687978 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:44.688511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:44.688947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:44.689631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:44.690117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:44.690558 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:44.702646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:44.710313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-98e48c79-4fa2-452c-a46d-c8ad7919f12a tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1507 microversion: 2.1 time: 0.166276 Aug 12 10:55:44.710860 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 347/726] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:44 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:45.026635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-52769e60-b2b1-4ba5-8901-a6e326473397 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350666 Aug 12 10:55:45.027252 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 380/727] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:55:44 2022] POST /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:55:45.546524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae256ba5-0b07-4359-b737-c287be74cc9e", "name": "network-vif-deleted", "tag": "22e33477-1d9d-42cf-8d23-a317fa68555d"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:45.558942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:45.559638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:45.559831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:45.571960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] Creating event network-vif-deleted:22e33477-1d9d-42cf-8d23-a317fa68555d for instance ae256ba5-0b07-4359-b737-c287be74cc9e on hv-cinder-85294 Aug 12 10:55:45.576866 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d0f8a40a-1e77-45db-a3e2-08f159a9b082 req-c9e64e0d-d036-4249-9240-7cd499da80b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034458 Aug 12 10:55:45.578812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 348/728] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:45.735443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:45.736158 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:45.744572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:45.745054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:45.745511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:45.746260 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:45.746706 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:45.747152 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:45.791323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:45.791700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:45.792125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:45.792604 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'fault' on Instance uuid ae256ba5-0b07-4359-b737-c287be74cc9e {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:45.838949 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:45.846862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4b0541ab-2913-46eb-8cae-efdc9631a64f tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 200 len: 1311 microversion: 2.1 time: 0.119220 Aug 12 10:55:45.847451 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 381/729] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:45 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:46.870384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:46.870932 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: ae256ba5-0b07-4359-b737-c287be74cc9e] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:46.877742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:46.878237 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:46.878670 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:46.879355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:46.879799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:46.880221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:46.895401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] HTTP exception thrown: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Request method failure captured: Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e HTTP/1.1 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBxx2qKhRWtVhvGuh4sEchgFVSGUIa--BMtLwuTuBpLIUtlMsFEmoEx5LnJVmgWRKw38eDPWOit2ByMv2oo007-7Kvzos32s8GTLgK16gfwrOC0b2HaUnFROCskJU4hSxBp4fDlrw5Cyn-AvRtWWZAyBPrhRzLv72BYk2wP63FCsN0 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:55:46.897370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc63f648a390465e94ab8170362a9b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}] Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 58e209063f5c454d87d9f743bedfc734 Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. Aug 12 10:55:46.898954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'ae256ba5-0b07-4359-b737-c287be74cc9e'} Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:46.899764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. Aug 12 10:55:46.902238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:46.903626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Returning 404 to user: Instance ae256ba5-0b07-4359-b737-c287be74cc9e could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:46.903626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fce6674e-f790-40e8-a95b-56bb750fb80c tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e" status: 404 len: 111 microversion: 2.1 time: 0.033606 Aug 12 10:55:46.903626 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 349/730] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:46 2022] GET /compute/v2.1/servers/ae256ba5-0b07-4359-b737-c287be74cc9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:55:46.909620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:46.910091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:46.919678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:46.920323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:46.920928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:46.921964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:46.922490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:46.923073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:46.929057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:55:46.951148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:55:47.035000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-aed7794c-fdbc-48d6-99f3-347a63cbdbaf tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 204 len: 0 microversion: 2.1 time: 0.130934 Aug 12 10:55:47.035562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 382/731] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:55:46 2022] DELETE /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:55:47.045949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:47.046565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:47.052596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:47.053075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:47.053629 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:47.054605 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:47.055064 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:47.055485 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:47.203917 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:47.212311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1b7ac00a-a897-4c09-83f1-48e39bd97103 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.171765 Aug 12 10:55:47.212891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 350/732] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:47 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:55:48.234769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:48.235578 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:48.243536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:48.244021 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:48.244495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:48.245197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:48.245648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:48.246069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:48.390713 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:48.400960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0ea8ab47-c525-46ee-8942-f93e53a6e23b tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.171287 Aug 12 10:55:48.401539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 383/733] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:48 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:49.424035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:49.424693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:49.431754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:49.432312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:49.432760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:49.433981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:49.434462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:49.434924 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:49.571400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:49.579797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-79489242-f956-48f8-af31-0085875971ae tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.160645 Aug 12 10:55:49.580401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 351/734] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:49 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:50.602277 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:50.602902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:50.610113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:50.610617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:50.611057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:50.611752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:50.612201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:50.612647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:50.762455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:50.770956 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0e21725d-acd8-4b4c-9b59-9cf1723c3a44 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1522 microversion: 2.1 time: 0.172700 Aug 12 10:55:50.771604 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 384/735] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:50 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:51.334417 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2b5d19a-4377-43cc-ae14-942386d69b71", "name": "network-vif-deleted", "tag": "2f69e421-8efb-40d6-a1be-fed18ae606f2"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:51.344606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:51.345111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:51.345546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:51.357526 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] Creating event network-vif-deleted:2f69e421-8efb-40d6-a1be-fed18ae606f2 for instance a2b5d19a-4377-43cc-ae14-942386d69b71 on hv-cinder-85294 Aug 12 10:55:51.362846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-0c1b59d9-fd6b-424f-a60f-74bc16c5b53d req-c564833f-4d1a-45cb-a108-adc0e9c168ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112192 Aug 12 10:55:51.363442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 352/736] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:55:51.793554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:51.795082 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:51.801920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:51.802455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:51.802927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:51.803635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:51.804087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:51.804629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:51.836531 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:51.837026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:51.837456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:51.837892 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lazy-loading 'fault' on Instance uuid a2b5d19a-4377-43cc-ae14-942386d69b71 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:51.889512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '58e209063f5c454d87d9f743bedfc734', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc63f648a390465e94ab8170362a9b01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:51.897968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-032c3283-da65-4843-a7ec-6fb4cccc09d4 tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 200 len: 1312 microversion: 2.1 time: 0.108717 Aug 12 10:55:51.898535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 385/737] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:51 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:52.607361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae0dad67-e927-46d2-bfae-e0a6108b4441"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:52.609812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:52.616576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.617059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.617484 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.618190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.618646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.619073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.703722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: POST /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments HTTP/1.1 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 74 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:55:52.705663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {"volumeAttachment": {"volumeId": "ae0dad67-e927-46d2-bfae-e0a6108b4441"}} Aug 12 10:55:52.707221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'server_id': 'd2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd', 'body': {'volumeAttachment': {'volumeId': 'ae0dad67-e927-46d2-bfae-e0a6108b4441'}}} Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.708078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.709263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 400 to user: Invalid volume: volume ae0dad67-e927-46d2-bfae-e0a6108b4441 is already attached to instances: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8b67e3a2-f3f7-4ff6-be72-9ecf3a529d12 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105167 Aug 12 10:55:52.710430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 353/738] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:55:52 2022] POST /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 12 10:55:52.779683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:52.780172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:52.786292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.786783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.787210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.787893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.788362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.788778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.869449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lazy-loading 'services' on Instance uuid d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:55:52.919230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:52.919921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] [instance: a2b5d19a-4377-43cc-ae14-942386d69b71] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:52.926988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.927418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.927841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.928668 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.929297 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.929946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.945683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] HTTP exception thrown: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Request method failure captured: Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 HTTP/1.1 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jBxx2qKhRWtVhvGuh4sEchgFVSGUIa--BMtLwuTuBpLIUtlMsFEmoEx5LnJVmgWRKw38eDPWOit2ByMv2oo007-7Kvzos32s8GTLgK16gfwrOC0b2HaUnFROCskJU4hSxBp4fDlrw5Cyn-AvRtWWZAyBPrhRzLv72BYk2wP63FCsN0 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:55:52.947239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_dc63f648a390465e94ab8170362a9b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/dc63f648a390465e94ab8170362a9b01"}]}] Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: dc63f648a390465e94ab8170362a9b01 Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-387755336 Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 58e209063f5c454d87d9f743bedfc734 Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-ServerRescueNegativeTestJSON-387755336-project Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. Aug 12 10:55:52.948815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'a2b5d19a-4377-43cc-ae14-942386d69b71'} Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:52.950119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. Aug 12 10:55:52.951580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:55:52.953045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] Returning 404 to user: Instance a2b5d19a-4377-43cc-ae14-942386d69b71 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:52.953045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-926b6eca-c3a9-4fb6-8858-49e99f8976fb tempest-ServerRescueNegativeTestJSON-387755336 tempest-ServerRescueNegativeTestJSON-387755336-project] 10.222.0.23 "GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71" status: 404 len: 111 microversion: 2.1 time: 0.033927 Aug 12 10:55:52.953045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 354/739] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:52 2022] GET /compute/v2.1/servers/a2b5d19a-4377-43cc-ae14-942386d69b71 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:55:52.954589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0c9ee0f0-c1eb-4951-bb68-80cb22bce536 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments/ae0dad67-e927-46d2-bfae-e0a6108b4441" status: 202 len: 0 microversion: 2.1 time: 0.178808 Aug 12 10:55:52.958487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 386/740] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:55:52 2022] DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments/ae0dad67-e927-46d2-bfae-e0a6108b4441 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:55:52.964216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:52.966431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:52.973822 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.974461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.974881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:52.975782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:52.976297 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:52.976790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:53.006309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-caac548b-bdb6-4288-b983-055b871a9c3c tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Aug 12 10:55:53.006882 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 355/741] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:52 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:54.020289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:54.023225 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:54.030429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.030911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.031341 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.032042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.032521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.032933 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.063287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-678270f6-40ef-427b-ad84-2470c5d3db79 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047853 Aug 12 10:55:54.063836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 387/742] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:55:54 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:55:54.130152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:54.130656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:54.137974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.138477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.138947 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.139658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.140122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.140729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.167883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:55:54.254948 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-269fd1b6-8e1f-4021-a7ad-08234637f6ee tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 204 len: 0 microversion: 2.1 time: 0.128593 Aug 12 10:55:54.255841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 356/743] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:55:54 2022] DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:55:54.264639 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:54.265574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:54.272677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.273166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.273608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.274306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:54.274775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:54.275181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:54.490021 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:54.498948 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-782e8e62-fb68-4d7c-8081-c0934c5c60bc tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1682 microversion: 2.1 time: 0.238665 Aug 12 10:55:54.499527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 388/744] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:54 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1682 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:55.522562 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:55.523194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:55.530225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:55.530716 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:55.531148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:55.531845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:55.532280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:55.532942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:55.671092 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:55.679323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a38f216e-34ac-4afd-8d65-a5adeeb5db54 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1682 microversion: 2.1 time: 0.161598 Aug 12 10:55:55.679909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 357/745] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:55 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:56.705796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:56.708325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:56.719429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:56.719922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:56.720380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:56.721096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:56.721541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:56.721957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:57.050175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:55:57.061783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-504cd6cf-cf34-43c5-b044-1664ba331d06 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 200 len: 1682 microversion: 2.1 time: 0.361601 Aug 12 10:55:57.077576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 389/746] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:56 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 1682 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:55:57.353235 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd", "name": "network-vif-deleted", "tag": "f54409a6-4171-4222-8566-4a1a55d5800a"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:57.364728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:57.365468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:57.366095 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:57.378990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] Creating event network-vif-deleted:f54409a6-4171-4222-8566-4a1a55d5800a for instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd on hv-cinder-85294 Aug 12 10:55:57.386653 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-705bbcd3-d47c-42cb-84a5-5068c532b51b req-88263991-24c7-4d96-948a-2ce823261fd2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037250 Aug 12 10:55:57.390871 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 358/747] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:55:58.086986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:58.087582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:55:58.094371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:58.094849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:58.095281 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:58.095969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:55:58.096442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:55:58.096850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:55:58.111505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd HTTP/1.1 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:55:58.113180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:55:58.114635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'd2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd'} Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:55:58.115432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:55:58.116658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:55:58.119093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:55:58.119973 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a76121ec-16c9-40f6-a356-309b4b3c9a77 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 404 len: 111 microversion: 2.1 time: 0.036875 Aug 12 10:55:58.120556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 390/748] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:55:58 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:55:58.131069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-eef594ed-cf31-4bca-99a4-8f57195c0e26 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '.version_select at 0x7efc5c783280>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:55:58.156353 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-eef594ed-cf31-4bca-99a4-8f57195c0e26 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-772306550" status: 202 len: 0 microversion: 2.1 time: 0.028515 Aug 12 10:55:58.157042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 359/749] 10.222.0.23 () {58 vars in 1218 bytes} [Fri Aug 12 10:55:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-772306550 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:55:58.870144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6b832d15-9dc5-465b-adbf-4da919538020 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: .version_select at 0x7efc5c9cdee0>, body: {"keypair": {"name": "tempest-keypair-1841751473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnZvX7FOC0tNcgWDPprhgijcrLOD2Id3plhW368/Xl8MmTvtJXYJ2jdOWYY06aFcDzK5fmDF5l24MjfH9f5ooBaimHA1R8hz/BDxeYIgiYCwf87qgeqdTRwWsuG8NSyZg=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:55:58.885497 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-6b832d15-9dc5-465b-adbf-4da919538020 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:55:58.889757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-6b832d15-9dc5-465b-adbf-4da919538020 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:55:58.914927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6b832d15-9dc5-465b-adbf-4da919538020 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049072 Aug 12 10:55:58.915799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 391/750] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:55:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:00.320839 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-135487315", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4619fc67-f793-4a22-b0bd-06a8104796b2"}], "security_groups": [{"name": "tempest-securitygroup--1937964327"}], "key_name": "tempest-keypair-1841751473", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:00.757280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] validate_networks() for [('4619fc67-f793-4a22-b0bd-06a8104796b2', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:56:01.409322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:56:01.409862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:56:01.410201 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:56:01.410606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:56:01.411050 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:56:01.423986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:01.424516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:01.424949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:01.425864 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:01.426471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:01.427047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:01.447031 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:56:01.451937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Getting quotas for user e0d5ff60d4b24fe0bbd771e8ed97db2f and project 362a04e0181b4fa49e27fb38c04ac677. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:56:01.465910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:56:01.468603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:56:01.523084 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3fa74e04-1fad-4691-a737-c5db0f31859a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.206321 Aug 12 10:56:01.524510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 360/751] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:56:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:56:01.536926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-18c22079-0256-4130-ab78-193dd349db2b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:01.537464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-18c22079-0256-4130-ab78-193dd349db2b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:01.628035 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-18c22079-0256-4130-ab78-193dd349db2b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:01.639186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-18c22079-0256-4130-ab78-193dd349db2b tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1241 microversion: 2.1 time: 0.106602 Aug 12 10:56:01.652294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 392/752] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:01 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:02.660222 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:02.660910 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:02.668095 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:02.668620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:02.669114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:02.669771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:02.670220 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:02.670642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:02.748389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:02.758301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e53bb76d-f005-48f8-a3b1-d42f97e5f4f4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1293 microversion: 2.1 time: 0.101178 Aug 12 10:56:02.759515 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 361/753] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:02 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:03.647063 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d318686d-c852-4f63-8e9d-b2ab1b4594a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: .version_select at 0x7efc5cb3d280>, body: {"keypair": {"name": "tempest-keypair-1057270753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEv53Q61N/bhFJE1rsa8IzVj6ZNxl2q3pCkwar9TkzhvTy1+hNT1N3VeaegY/8jEGfTrlzcgyHEapO/o/hR+N9afrM8PeNy8oZCTLtRHSIaX+LkKQ/BXrveJNAcTMjjHg=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:03.663626 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-d318686d-c852-4f63-8e9d-b2ab1b4594a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for project b93ff276e6894c77a231ef075b02ca9a. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:56:03.667475 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-d318686d-c852-4f63-8e9d-b2ab1b4594a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for user 5cde581444394ae0b342d0c1ec435c76 and project b93ff276e6894c77a231ef075b02ca9a. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:56:03.697115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d318686d-c852-4f63-8e9d-b2ab1b4594a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.224875 Aug 12 10:56:03.700943 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 393/754] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:56:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:03.781361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:03.782514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:03.790788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:03.791541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:03.792412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:03.794052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:03.794904 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:03.795738 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:03.885457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:03.900599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b388411f-933a-46a1-ab51-585ba719a402 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1299 microversion: 2.1 time: 0.122670 Aug 12 10:56:03.916877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 362/755] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:03 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1299 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:04.841094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd97bb25-90c4-4774-bd6c-e345bc6ae17f", "tag": "eae1eea5-3aff-4f74-9056-7b6614cacadf"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:04.867758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:04.868235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:04.868687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:04.882684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] Creating event network-changed:eae1eea5-3aff-4f74-9056-7b6614cacadf for instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f on hv-cinder-85294 Aug 12 10:56:04.891463 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-c972c9ac-1079-43cb-9db6-a1a2f54ed44d req-9bba84e5-9c3f-49de-a4ee-c206cf4bbb7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055173 Aug 12 10:56:04.896923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 394/756] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:04.923896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:04.924642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:04.932895 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:04.933548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:04.934326 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:04.935433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:04.935995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:04.936542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:05.151771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:05.161253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-19ee095d-5ce0-4933-9043-faf2ef6577f9 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.242068 Aug 12 10:56:05.166639 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 363/757] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:04 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:05.343206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-412815843", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30c65d8e-0ee5-4530-82d1-53538bb488b6"}], "security_groups": [{"name": "tempest-securitygroup--797568204"}], "key_name": "tempest-keypair-1057270753", "user_data": "}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:05.453240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] validate_networks() for [('30c65d8e-0ee5-4530-82d1-53538bb488b6', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:56:05.875145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:56:05.875750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:56:05.876073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:56:05.876500 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:56:05.876900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:56:05.886167 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:05.886762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:05.887188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:05.887937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:05.888401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:05.888812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:05.906423 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for project b93ff276e6894c77a231ef075b02ca9a. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:56:05.910835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for user 5cde581444394ae0b342d0c1ec435c76 and project b93ff276e6894c77a231ef075b02ca9a. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:56:05.922178 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:56:05.924615 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:56:05.972647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-35fa9c0d-f15b-414a-a33d-888d485bf3fd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634150 Aug 12 10:56:05.973481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 395/758] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:56:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:56:05.985619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3f6de256-7835-491f-ad6c-264b3486b5d0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:05.986299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3f6de256-7835-491f-ad6c-264b3486b5d0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:05.988819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:06.059541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3f6de256-7835-491f-ad6c-264b3486b5d0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:06.066752 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3f6de256-7835-491f-ad6c-264b3486b5d0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1237 microversion: 2.1 time: 0.085398 Aug 12 10:56:06.067314 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 364/759] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:05 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:06.182696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:06.184351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:06.191834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:06.192457 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:06.192960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:06.193754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:06.194417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:06.194907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:06.339834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:06.351232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5d7637e0-9d3f-4176-98ae-8c97503c995f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.172310 Aug 12 10:56:06.352317 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 396/760] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:06 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:07.087182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:07.087868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:07.096224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:07.096729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:07.097159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:07.097858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:07.098308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:07.098730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:07.194225 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:07.203867 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fd90ee5b-023c-4bc4-aab8-145a3d419e01 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1289 microversion: 2.1 time: 0.120569 Aug 12 10:56:07.204496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 365/761] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:07 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:07.373274 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:07.374535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:07.377094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:07.382368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:07.383104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:07.383719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:07.384486 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:07.384951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:07.385366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:07.522749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:07.530203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9e00b5e6-6c20-4f60-8281-fef118ddf6e5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.160942 Aug 12 10:56:07.530754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 397/762] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:07 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:08.225421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:08.226090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:08.233842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:08.234334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:08.235381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:08.236283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:08.236747 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:08.237169 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:08.393762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:08.401802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f9abebf9-a92e-4514-92bf-04645e87309b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.180796 Aug 12 10:56:08.403244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 366/763] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:08 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:08.553051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:08.553761 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:08.562280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:08.562280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:08.562552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:08.563252 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:08.563697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:08.564114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:08.707476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:08.716380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-82e21031-6ecc-4f4e-8256-a34a94e9df4f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.168659 Aug 12 10:56:08.717036 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 398/764] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:08 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:08.809716 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d", "tag": "0e990323-9e61-4df5-bcd8-ed0475552190"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:08.819733 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:08.820355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:08.820858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:08.833731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] Creating event network-changed:0e990323-9e61-4df5-bcd8-ed0475552190 for instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d on hv-cinder-85294 Aug 12 10:56:08.839311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-0543372f-8dc2-4b96-9fd5-3f388b25f7bb req-354b9fc7-45e7-4bf8-907e-a9b261e77570 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Aug 12 10:56:08.839911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 367/765] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:09.289202 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd97bb25-90c4-4774-bd6c-e345bc6ae17f", "name": "network-vif-plugged", "status": "completed", "tag": "eae1eea5-3aff-4f74-9056-7b6614cacadf"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:09.299010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:09.300088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:09.300088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:09.313083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] Creating event network-vif-plugged:eae1eea5-3aff-4f74-9056-7b6614cacadf for instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f on hv-cinder-85294 Aug 12 10:56:09.317919 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-3ca5ff5c-94a7-40dc-9dd5-d22ae5b4b2c5 req-4376d017-2e39-47ab-8257-d860dc3e68d5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093447 Aug 12 10:56:09.318507 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 399/766] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:09.425651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:09.426538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:09.435401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:09.436018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:09.436599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:09.437459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:09.438021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:09.438524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:09.589413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:09.597600 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a3b93850-cbf6-49ed-b43e-8dd9755087b9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.177204 Aug 12 10:56:09.598171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 368/767] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:09 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:09.742363 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:09.743514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:09.751298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:09.751782 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:09.752220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:09.752947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:09.753403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:09.753824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:09.886819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:09.894753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fd1a0669-1cfb-4c4b-ab8c-9f6915dc1685 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.160257 Aug 12 10:56:09.895364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 400/768] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:09 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:10.618696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:10.619311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:10.626351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:10.626844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:10.627287 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:10.627985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:10.628492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:10.628921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:10.631588 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:10.769075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:10.777049 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a39ed27d-562a-4fcf-bd2c-50a2e7368921 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.162369 Aug 12 10:56:10.777749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 369/769] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:10 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:10.915196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:10.915789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:10.922725 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:10.923201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:10.923633 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:10.924406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:10.924859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:10.925276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:11.059465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:11.064490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:11.070942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0a6a21c5-1b5a-4649-9fd2-315c0e9f2d88 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1367 microversion: 2.1 time: 0.159300 Aug 12 10:56:11.072406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 401/770] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:10 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:11.799970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:11.800616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:11.803522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:11.808658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:11.809140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:11.809609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:11.810504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:11.810951 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:11.811369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:11.946275 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:11.955993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-49fcfb36-8dcf-4c69-a44f-87abe079df5d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.160940 Aug 12 10:56:11.960476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 370/771] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:11 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:12.093765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:12.094370 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:12.103952 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.104665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.105290 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:12.106652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.107544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.108052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:12.247295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:12.255498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b14d26fb-b9a3-4a52-8f86-4e5b98be400e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1557 microversion: 2.1 time: 0.166264 Aug 12 10:56:12.256076 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 402/772] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:12 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:12.276291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:12.276941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:12.283251 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.283740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.284173 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:12.284896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.285345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.285768 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:12.365204 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0b4f403b-58af-4e22-9d0c-a71819e9c4cf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093583 Aug 12 10:56:12.365790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 371/773] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:56:12 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:12.976763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:12.977375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:12.983495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.983977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.984447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:12.985144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:12.985592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:12.986003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:13.193629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:13.202515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ba1e6989-8e34-4b4f-a5b4-5adce01d70ec tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.229540 Aug 12 10:56:13.203069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 403/774] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:12 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:13.293180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d", "name": "network-vif-plugged", "status": "completed", "tag": "0e990323-9e61-4df5-bcd8-ed0475552190"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:13.303685 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:13.304416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:13.304927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:13.316890 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] Creating event network-vif-plugged:0e990323-9e61-4df5-bcd8-ed0475552190 for instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d on hv-cinder-85294 Aug 12 10:56:13.321938 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-ef01e210-b24a-4071-b1b8-a525a90e9423 req-05c45716-07b9-4f6f-b811-ed48347bbba8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033196 Aug 12 10:56:13.322620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 372/775] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:13.475660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd97bb25-90c4-4774-bd6c-e345bc6ae17f", "tag": "eae1eea5-3aff-4f74-9056-7b6614cacadf"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:13.486601 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:13.487069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:13.487493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:13.499510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] Creating event network-changed:eae1eea5-3aff-4f74-9056-7b6614cacadf for instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f on hv-cinder-85294 Aug 12 10:56:13.504145 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-1499e8b0-3a6c-4de8-9bdd-e68bc811f632 req-85ea280e-66f1-4c1a-9e95-c3625edbe810 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098070 Aug 12 10:56:13.505041 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 404/776] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:14.223837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:14.224564 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:14.231760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:14.232298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:14.232770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:14.233553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:14.234044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:14.234432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:14.375841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:14.383459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dbba813a-a3b4-4f93-82e2-8f59f53bf9bc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.163939 Aug 12 10:56:14.384043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 373/777] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:14 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:15.342213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1776652398"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:15.342833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:15.349643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:15.350117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:15.350541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:15.351242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:15.351684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:15.352097 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:15.405584 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:15.406214 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:15.412715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:15.413183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:15.413821 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:15.414521 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:15.414974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:15.415398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:15.776199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.network.security_group_api [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Removing security group 39b1cd2d-9fc0-4256-9f6e-1282a83da651 from port e484be44-9101-4901-960d-8ef8e89f6800 Aug 12 10:56:15.895071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:15.896422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:15.903707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3725b830-6c0e-47d6-8ab4-fa8c366d7ef9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1362 microversion: 2.1 time: 0.502247 Aug 12 10:56:15.904307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 374/778] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:15 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:15.917176 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=16 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:16.124907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e5febcbe-4c22-42e8-a79c-dff3a059c0bf tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action" status: 202 len: 0 microversion: 2.1 time: 0.787848 Aug 12 10:56:16.125616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 405/779] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:56:15 2022] POST /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:56:16.142278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:16.174336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=8 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:16.180405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:16.180862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:16.181362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:16.197176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] Creating event network-changed:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:56:16.205091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-34eb6b46-f091-49ea-91d0-7a998fa34394 req-ecae5b87-dd48-40a9-ab64-7f4cd8cab8b6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066808 Aug 12 10:56:16.208424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 375/780] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:16.925117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:16.925686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:16.932234 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:16.932766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:16.933204 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:16.933908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:16.934359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:16.934815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.144028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:17.152605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-17c34ae7-1d0d-453d-9c77-9aa34f6e2f9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1548 microversion: 2.1 time: 0.231993 Aug 12 10:56:17.153410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 406/781] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:16 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:17.174959 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:17.175553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:17.182141 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.182628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.183068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.183760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.184210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.184663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.298422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-46ea2286-da51-4670-bb82-bbf1d5eaf167 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128258 Aug 12 10:56:17.298994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 376/782] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:56:17 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:17.355345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:17.356196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:17.363851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.364602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.365038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.365749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.366198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.366790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.455746 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lazy-loading 'services' on Instance uuid ed905e2d-f2df-4a60-bb2b-93a798b1fc75 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:56:17.548420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6085150e-f84d-4488-8ec3-e648fbe56014 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments/101e424c-75e6-47a5-ba91-0d3e6c84fc3b" status: 202 len: 0 microversion: 2.1 time: 0.196819 Aug 12 10:56:17.552249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 407/783] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:56:17 2022] DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments/101e424c-75e6-47a5-ba91-0d3e6c84fc3b => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:56:17.559387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:17.564359 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:17.575171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.575832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.576341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.577362 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:17.578013 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:17.578607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:17.614065 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2f1b6bb6-8bb0-43f0-ba87-8f29f5102c24 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059758 Aug 12 10:56:17.619518 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 377/784] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:56:17 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:18.223263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:18.234531 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.235256 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.235887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.248896 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] Creating event network-changed:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:56:18.253944 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-93d1adc1-5554-4d69-8537-284173877f9a req-28b98941-0347-4a21-902c-7195d3c20f79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035450 Aug 12 10:56:18.254732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 408/785] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:18.628045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:18.630528 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:18.637476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.638162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.638812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.639717 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.640140 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.640775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.671492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3c8cdce4-1e66-4733-ae64-0fcc9ad15390 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047497 Aug 12 10:56:18.672102 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 378/786] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:56:18 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:56:18.683703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:18.684375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:18.690984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.691565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.692010 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.692766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.693219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.693652 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.786371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d", "tag": "0e990323-9e61-4df5-bcd8-ed0475552190"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:18.788974 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] HTTP exception thrown: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 is not attached to volume 101e424c-75e6-47a5-ba91-0d3e6c84fc3b Aug 12 10:56:18.796157 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:18.796919 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:18.797513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Request method failure captured: Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments/101e424c-75e6-47a5-ba91-0d3e6c84fc3b HTTP/1.1 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jEkBzeCIUG9PU0OZ7Rlk_A-2DnWDHNOlqvsLui5Cc2CVBwzgFlyjM7pw0HfH2ZFsoujDT60B8eX5D7fo9is-ecN9IQhi_a8fWbnExbg12VJMqtQm1IWSQ-qAenw7sUDrPtzNLesC3ghW20jG6poEr38oRO8TUni5s53AWgBWNThnvg Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 807c809e71de43ebb4edecbab4bc4292 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:56:18.798922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/807c809e71de43ebb4edecbab4bc4292"}]}] Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 807c809e71de43ebb4edecbab4bc4292 Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestMinimumBasicScenario-906629389-project Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 3f40eebcea60459ab0cf9233aea9b743 Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestMinimumBasicScenario-906629389-project Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:56:18.800620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 is not attached to volume 101e424c-75e6-47a5-ba91-0d3e6c84fc3b Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'server_id': 'ed905e2d-f2df-4a60-bb2b-93a798b1fc75', 'id': '101e424c-75e6-47a5-ba91-0d3e6c84fc3b'} Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 101e424c-75e6-47a5-ba91-0d3e6c84fc3b. Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:56:18.801513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 is not attached to volume 101e424c-75e6-47a5-ba91-0d3e6c84fc3b Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 is not attached to volume 101e424c-75e6-47a5-ba91-0d3e6c84fc3b Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:18.802955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Returning 404 to user: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 is not attached to volume 101e424c-75e6-47a5-ba91-0d3e6c84fc3b {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:56:18.804098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-93434726-eaf8-481c-aa18-0810a213a7b2 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments/101e424c-75e6-47a5-ba91-0d3e6c84fc3b" status: 404 len: 154 microversion: 2.1 time: 0.123426 Aug 12 10:56:18.804390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 409/787] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:56:18 2022] DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75/os-volume_attachments/101e424c-75e6-47a5-ba91-0d3e6c84fc3b => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:56:18.820789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] Creating event network-changed:0e990323-9e61-4df5-bcd8-ed0475552190 for instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d on hv-cinder-85294 Aug 12 10:56:18.828036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-55c1773a-b9dc-4cda-8378-9b9b0339c2ec req-bfd818df-d175-4e3c-95a7-466a81e80d8e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051029 Aug 12 10:56:18.829398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 379/788] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:19.973352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:19.974421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:19.981255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:19.981931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:19.982367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:19.983056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:19.983485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:19.983920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:20.010007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:56:20.092937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f7689d01-c0c2-426b-81ce-ee9e2a0cd2e7 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 204 len: 0 microversion: 2.1 time: 0.123090 Aug 12 10:56:20.093978 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 410/789] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:56:19 2022] DELETE /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:56:20.102715 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:20.103411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:20.111226 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:20.111707 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:20.112136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:20.112862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:20.113310 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:20.113703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:20.252557 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:20.260679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d348402f-1dc7-4fba-bc15-793c3d7ca1ce tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1553 microversion: 2.1 time: 0.162104 Aug 12 10:56:20.261253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 380/790] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:20 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:21.285315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:21.285976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:21.292939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:21.293441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:21.293893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:21.294575 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:21.295021 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:21.295435 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:21.440619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:21.450790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6c241610-8865-474f-9b9f-a449d1313f44 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1553 microversion: 2.1 time: 0.170045 Aug 12 10:56:21.451763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 411/791] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:21 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:56:22.326471 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:22.327030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:22.333972 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:22.334468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:22.334906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:22.335656 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:22.336120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:22.336576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:22.362293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-10536c3e-159c-453b-ad48-925514e599a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/ips" status: 200 len: 153 microversion: 2.20 time: 0.039788 Aug 12 10:56:22.362868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 381/792] 10.222.0.23 () {60 vars in 1289 bytes} [Fri Aug 12 10:56:22 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:56:22.472941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:22.473703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed905e2d-f2df-4a60-bb2b-93a798b1fc75", "name": "network-vif-deleted", "tag": "e484be44-9101-4901-960d-8ef8e89f6800"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:22.482394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:22.490711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:22.491410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:22.491703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:22.491848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:22.492506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:22.493113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:22.493970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:22.494576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:22.495358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:22.509077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] Creating event network-vif-deleted:e484be44-9101-4901-960d-8ef8e89f6800 for instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 on hv-cinder-85294 Aug 12 10:56:22.515700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-0b3c1a84-d465-483a-a15e-01b5b674d40d req-9c85603d-1e33-410b-b36e-f60f0d8ea330 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052842 Aug 12 10:56:22.516671 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 412/793] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:22.571388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f40eebcea60459ab0cf9233aea9b743', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '807c809e71de43ebb4edecbab4bc4292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:22.589913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4a20bd4d-fc33-487a-b095-7433c1750d63 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 200 len: 1343 microversion: 2.1 time: 0.121255 Aug 12 10:56:22.590879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 382/794] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:22 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 1343 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:56:23.614007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:23.614587 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] [instance: ed905e2d-f2df-4a60-bb2b-93a798b1fc75] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:23.621378 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:23.621856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:23.622283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:23.622972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:23.623416 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:23.623828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:23.638348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] HTTP exception thrown: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Request method failure captured: Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 HTTP/1.1 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jEkBzeCIUG9PU0OZ7Rlk_A-2DnWDHNOlqvsLui5Cc2CVBwzgFlyjM7pw0HfH2ZFsoujDT60B8eX5D7fo9is-ecN9IQhi_a8fWbnExbg12VJMqtQm1IWSQ-qAenw7sUDrPtzNLesC3ghW20jG6poEr38oRO8TUni5s53AWgBWNThnvg Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 807c809e71de43ebb4edecbab4bc4292 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:56:23.640053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_807c809e71de43ebb4edecbab4bc4292"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/807c809e71de43ebb4edecbab4bc4292"}]}] Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 807c809e71de43ebb4edecbab4bc4292 Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestMinimumBasicScenario-906629389 Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestMinimumBasicScenario-906629389-project Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 3f40eebcea60459ab0cf9233aea9b743 Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestMinimumBasicScenario-906629389-project Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. Aug 12 10:56:23.641607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'ed905e2d-f2df-4a60-bb2b-93a798b1fc75'} Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:56:23.642647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. Aug 12 10:56:23.643927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:56:23.645455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Returning 404 to user: Instance ed905e2d-f2df-4a60-bb2b-93a798b1fc75 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:56:23.645455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ec288b34-d985-44df-ad67-eb98d074f658 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75" status: 404 len: 111 microversion: 2.1 time: 0.032964 Aug 12 10:56:23.645455 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 413/795] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:56:23 2022] GET /compute/v2.1/servers/ed905e2d-f2df-4a60-bb2b-93a798b1fc75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:56:23.650989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2aad6b0b-f418-4fc7-ab39-cb3455da56b0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] Calling method '.version_select at 0x7efc5c799f70>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:23.674370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2aad6b0b-f418-4fc7-ab39-cb3455da56b0 tempest-TestMinimumBasicScenario-906629389 tempest-TestMinimumBasicScenario-906629389-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1282635168" status: 202 len: 0 microversion: 2.1 time: 0.027459 Aug 12 10:56:23.674964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 383/796] 10.222.0.23 () {58 vars in 1272 bytes} [Fri Aug 12 10:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1282635168 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:56:24.226471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:24.227340 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:24.234342 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:24.234972 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:24.235479 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:24.236173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:24.236648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:24.237037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:24.261835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lazy-loading 'flavor' on Instance uuid 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:56:24.461088 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d1e25d7c-95bb-45a8-8611-8449bacabdf1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/action" status: 202 len: 0 microversion: 2.20 time: 0.238291 Aug 12 10:56:24.461708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 414/797] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Aug 12 10:56:24 2022] POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:56:24.470762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:24.471312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:24.479827 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:24.480332 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:24.480775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:24.481480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:24.481937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:24.482369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:24.617669 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:24.625813 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:24.627325 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:24.628534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8389ad2a-397d-40f9-a566-9037fe5b24a0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.162278 Aug 12 10:56:24.629098 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 384/798] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:24 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:25.653042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:25.653971 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:25.661231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:25.661724 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:25.662143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:25.662848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:25.663290 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:25.663702 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:25.808232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:25.816636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:25.818105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:25.819418 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e294b6e6-05bd-49b5-889a-20950d7549d2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.171835 Aug 12 10:56:25.819948 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 415/799] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:25 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:26.843288 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:26.844543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:26.856635 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:26.857148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:26.857884 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:26.858973 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:26.860411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:26.860850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:27.037096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:27.045871 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:27.047501 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:27.048732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e85b9acd-00e2-4f16-a6c3-0cd3f8695cfb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.209549 Aug 12 10:56:27.049307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 385/800] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:26 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:28.071850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:28.072500 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:28.080299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:28.080803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:28.081249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:28.081963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:28.082499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:28.082928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:28.307602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:28.316372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:28.317813 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:28.318990 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4f79ea0c-188a-41ae-b425-c1d064aeca9a tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.251160 Aug 12 10:56:28.319536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 416/801] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:28 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:29.345141 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:29.346468 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:29.358419 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:29.359597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:29.360395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:29.361310 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:29.361784 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:29.362219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:29.616727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:29.627012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:29.629531 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:29.630945 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4e009495-ed3f-4569-a420-bfc7f8de3ded tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.292854 Aug 12 10:56:29.645703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 386/802] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:29 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:30.655157 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:30.655807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:30.662371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:30.662779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:30.663218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:30.663904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:30.664405 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:30.664822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:30.668996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:30.878744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:30.887612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:30.889315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:30.890635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f8c986f2-65eb-498e-b389-2cef289d3ad3 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.239536 Aug 12 10:56:30.891690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 417/803] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:30 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:31.915041 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:31.916981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:31.923520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:31.924081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:31.924672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:31.925420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:31.925930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:31.926623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:32.074105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:32.084081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:32.086489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:32.087958 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-72dda6ba-6985-4906-a880-e1308fffaff4 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.176891 Aug 12 10:56:32.088662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 387/804] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:31 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:33.121721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:33.122716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:33.130592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:33.131078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:33.131512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:33.132217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:33.132715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:33.133143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:33.274808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:33.283102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:33.284630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:33.285788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c135b77e-a557-4e24-bc60-d4dcbb038d03 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.170698 Aug 12 10:56:33.286347 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 418/805] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:33 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:34.313068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:34.314044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:34.325138 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:34.325936 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:34.326653 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:34.327867 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:34.328534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:34.328963 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:34.461837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:34.470349 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:34.471837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:34.473024 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-09610755-9c14-432c-ba76-8287f269a8b7 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.166981 Aug 12 10:56:34.473581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 388/806] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:34 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:35.499917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:35.500703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:35.509773 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:35.510489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:35.511110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:35.512151 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:35.512855 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:35.513517 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:35.677194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:35.685442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:35.686920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:35.688061 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ff7455a7-bfb3-419b-bf58-47047d31a835 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1744 microversion: 2.20 time: 0.194582 Aug 12 10:56:35.688643 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 419/807] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:35 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1744 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:36.715257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:36.716252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:36.719791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:36.725164 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:36.725643 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:36.726074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:36.726760 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:36.727203 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:36.727625 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:36.858183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:36.861477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=100 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:36.868783 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:36.870323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:36.871499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cd7fb83d-c3e8-4e37-8356-5583da29c2ba tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1744 microversion: 2.20 time: 0.162918 Aug 12 10:56:36.872088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 389/808] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:36 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:37.893910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:37.894472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:37.896868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:37.902678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:37.903150 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:37.903577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:37.904243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:37.904708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:37.905121 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:38.037414 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:38.046077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:38.047700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:38.048938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-338c756d-ea1d-4445-8993-9b96a3285e04 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.159192 Aug 12 10:56:38.049504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 420/809] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:37 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:39.071253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:39.071891 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:39.079967 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:39.080556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:39.081246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:39.081969 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:39.082431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:39.082878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:39.288762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:39.302714 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:39.304565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:39.306241 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b5425f4d-7781-433e-9426-b6d58aced081 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.239019 Aug 12 10:56:39.307808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 390/810] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:39 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:39.447857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "name": "network-vif-plugged", "status": "completed", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:39.461803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:39.462721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:39.463241 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:39.478967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] Creating event network-vif-plugged:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:56:39.486464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-260482cd-24dd-4d56-97c9-424380642dd4 req-6015a6af-8a01-4af7-86de-d170bf8c6c7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042569 Aug 12 10:56:39.487330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 421/811] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:40.330211 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:40.331378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:40.342124 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:40.342922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:40.343583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:40.344569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:40.345250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:40.345927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:40.683893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:40.692703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:40.694266 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:40.695636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f67646c2-9933-4252-9974-b9d1010988dc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.369929 Aug 12 10:56:40.709129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 391/812] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:40 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:41.719975 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:41.722224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:41.729177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:41.729733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:41.730228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:41.731017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:41.731574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:41.732084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:41.899382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:41.909155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:41.910640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:41.911838 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-02f2b623-6178-4929-aa84-fa95301026d0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.196529 Aug 12 10:56:41.924188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 422/813] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:41 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:42.935695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:42.937257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:42.945261 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:42.945759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:42.946200 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:42.946920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:42.947360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:42.947790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:43.089915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:43.098793 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:43.100316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:43.101519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a722f0d4-7ce8-43d0-8b0a-929d2842b5d5 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.170554 Aug 12 10:56:43.102107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 392/814] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:42 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:44.124092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:44.125602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:44.132911 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:44.133786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:44.134282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:44.135066 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:44.135608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:44.136098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:44.279942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:44.292312 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:44.293849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:44.295021 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a13e6769-9963-4757-93a7-8a98e00890bd tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.174921 Aug 12 10:56:44.295771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 423/815] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:44 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:45.319091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:45.319713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:45.326026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:45.326551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:45.326991 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:45.327902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:45.328413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:45.328840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:45.480387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:45.488940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:45.490425 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:45.491610 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-95aab61a-215b-4b4c-a621-c20185ee9290 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.177252 Aug 12 10:56:45.492171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 393/816] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:45 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:46.515492 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:46.516109 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:46.522280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:46.522771 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:46.523556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:46.524255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:46.524740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:46.525165 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:46.663456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:46.677179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:46.679662 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:46.681663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dc84fdea-7869-4a35-b1be-5cecda945377 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1739 microversion: 2.20 time: 0.170335 Aug 12 10:56:46.682655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 424/817] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:46 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:47.710858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:47.711463 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:47.720597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:47.721334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:47.722008 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:47.723122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:47.723893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:47.724550 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:47.874354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:47.883162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:47.884686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:47.885915 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-acf7cd3b-3a45-4d1f-a1bc-668ac8f6b004 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1721 microversion: 2.20 time: 0.182313 Aug 12 10:56:47.886472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 394/818] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:47 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:48.914270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:48.915250 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:48.926361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:48.927160 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:48.927879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:48.929080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:48.929824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:48.930515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:49.072679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:49.081329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:49.082822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:49.083980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-372f7afe-3ebf-4d5f-a222-01ae3f9c2a64 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1721 microversion: 2.20 time: 0.176848 Aug 12 10:56:49.084583 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 425/819] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:48 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:50.107543 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:50.108530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:50.115418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.115909 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.116358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:50.117117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.118081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.118081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:50.258694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:50.271074 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:50.273740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:50.275478 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-927d18a6-2bd1-4547-add9-edb91dfb879e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1664 microversion: 2.20 time: 0.171694 Aug 12 10:56:50.276280 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 395/820] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:50 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1664 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:50.298284 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ede1ba52-701d-41c1-a24e-a0936e2efbaa"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:50.300642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:50.307473 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.307948 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.308414 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:50.309100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.309545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.309960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:50.619657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-08af039f-72cc-42e0-a277-2e433664f7ab tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325498 Aug 12 10:56:50.620207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 426/821] 10.222.0.23 () {62 vars in 1364 bytes} [Fri Aug 12 10:56:50 2022] POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 12 10:56:50.746621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:50.747122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:50.753864 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.754364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.754805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:50.755506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:50.755988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:50.756432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.021851 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-700bba1f-ab14-434a-9405-9068635694d1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments/ede1ba52-701d-41c1-a24e-a0936e2efbaa" status: 202 len: 0 microversion: 2.20 time: 0.279480 Aug 12 10:56:51.022443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 396/822] 10.222.0.23 () {60 vars in 1457 bytes} [Fri Aug 12 10:56:50 2022] DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments/ede1ba52-701d-41c1-a24e-a0936e2efbaa => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:56:51.081727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:51.082322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:51.089074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.089568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.089986 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.090714 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.091172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.091598 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.120885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132240) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 10:56:51.190332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e00dbaae-6db2-44ba-91dd-6f251f292f2e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/action" status: 202 len: 0 microversion: 2.20 time: 0.112562 Aug 12 10:56:51.191055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 427/823] 10.222.0.23 () {62 vars in 1319 bytes} [Fri Aug 12 10:56:51 2022] POST /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:56:51.199659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:51.200492 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:51.208002 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.208842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.209381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.210289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.211009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.211406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.236843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:51.237411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:51.253353 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.254031 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.254469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.255186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.255644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.256068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.286301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-73c30cce-e5c4-4997-bf74-c0d6daa4872a tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/ips" status: 200 len: 149 microversion: 2.1 time: 0.053654 Aug 12 10:56:51.287503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 428/824] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:56:51 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/ips => generated 149 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:51.398324 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:51.406607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:51.408762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:51.412390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d7443aaa-9a47-406c-b71a-5af0bf397ae9 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1672 microversion: 2.20 time: 0.216974 Aug 12 10:56:51.413795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 397/825] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:51 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1672 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:51.430474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "name": "network-vif-unplugged", "status": "completed", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:51.442441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:51.443306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:51.444098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:51.461684 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.compute.server_external_events [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] Unable to find a host for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5. Dropping event network-vif-unplugged {{(pid=132240) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 10:56:51.463357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-e5dfc212-24ae-4291-9258-df49f2f83387 req-4424014a-a353-4042-a833-1b3b64420fa0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037080 Aug 12 10:56:51.464859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 429/826] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 10:56:52.436871 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:52.437480 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:52.444630 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:52.445227 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:52.445659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:52.446358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:52.446808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:52.447229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:52.577538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:52.586749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:52.589044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:52.590163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-669a8f25-ffde-4a19-8ada-06ef6567de4d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.157336 Aug 12 10:56:52.590711 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 398/827] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:52 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:52.663525 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dbbaf3f2-da3d-4c2d-b924-7225331a18da"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:52.665815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:52.672307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:52.672766 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:52.673412 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:52.674146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:52.674627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:52.675155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:52.955750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=4,nova_cell1:UPDATE=7 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:56:52.975739 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-275d1526-41a0-4ee0-8ec0-f990008e5bbf tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "POST /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316381 Aug 12 10:56:52.976406 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 430/828] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:56:52 2022] POST /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:53.616758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:53.618246 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:53.628355 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:53.629190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:53.629964 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:53.630930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:53.631410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:53.631875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:53.788052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:53.797303 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:53.798811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:53.800419 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2db81369-613f-42fe-ab5f-42901d80d7f0 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.189432 Aug 12 10:56:53.800987 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 399/829] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:53 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:54.824654 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:54.825443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:54.832238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:54.832754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:54.833184 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:54.833898 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:54.834345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:54.834765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:54.978253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:54.986604 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:54.988277 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:54.989457 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d3057663-bee6-4aac-89d5-ef16996a795c tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.169876 Aug 12 10:56:54.990213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 431/830] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:54 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:55.040851 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:55.041591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:55.048282 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:55.048780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:55.049283 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:55.049961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:55.050632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:55.051062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:55.076773 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-29b35909-94ff-4e6f-b1c2-d92a75d36263 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/ips" status: 200 len: 146 microversion: 2.1 time: 0.039702 Aug 12 10:56:55.077608 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 400/831] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:56:55 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:56:56.012536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:56.013115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:56.020853 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:56.021499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:56.022102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:56.022864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:56.023789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:56.024281 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:56.161270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:56.170372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:56.172032 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:56.173372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-fff79b54-6e35-49a0-826f-99eeb6e427cf tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.164972 Aug 12 10:56:56.175617 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 432/832] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:56 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:57.197317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:57.198554 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:57.214202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:57.215231 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:57.215612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:57.217183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:57.217673 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:57.218104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:57.415946 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:57.425347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:57.427304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:57.428546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-038d304b-4dfd-49e6-acae-da43e2222938 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.235697 Aug 12 10:56:57.440538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 401/833] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:57 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:58.452914 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:58.453594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:58.461422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:58.462196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:58.462590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:58.463536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:58.463985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:58.464436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:58.611788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:58.622619 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:58.624151 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:58.625388 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-41498f6b-d591-4938-b31d-544398f42e97 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.176565 Aug 12 10:56:58.626166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 433/834] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:58 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:56:58.842829 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "541649eb-10e5-4fc0-8221-50f0a2330ba5"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:56:58.846357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:58.854383 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:58.855221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:58.855745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:58.856697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:58.857222 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:58.857737 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:59.651142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:56:59.652513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:56:59.659743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:59.660105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:59.660563 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:59.661288 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:56:59.661861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:56:59.662289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:56:59.806445 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:59.814807 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:59.816443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:56:59.817602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9b6ab475-4d8c-44d9-bd9a-05c5a558ee05 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.170913 Aug 12 10:56:59.818159 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 434/835] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:56:59 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:00.841263 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:00.841978 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:00.848877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:00.849364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:00.849796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:00.850506 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:00.850953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:00.851359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:00.996213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:01.005372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:01.006886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:01.008045 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7dfc290d-b70d-4df1-b0b7-24521dff87cb tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.170722 Aug 12 10:57:01.008952 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 435/836] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:00 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:02.035825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:02.036568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:02.046628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:02.050179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:02.050938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:02.051656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:02.052116 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:02.052571 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:02.188693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:02.197152 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:02.198629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:02.199774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a21c1ca0-3451-4eaa-aec4-af7a0a2b448e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.170711 Aug 12 10:57:02.200365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 436/837] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:02 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:02.769322 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:02.781165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9943e3f1-1b0a-479a-b598-18199b44eab6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.942334 Aug 12 10:57:02.781776 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 402/838] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 10:56:58 2022] POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments => generated 194 bytes in 3944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:03.224138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:03.224693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:03.231796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:03.232368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:03.232782 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:03.233510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:03.233981 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:03.234421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:03.387135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:03.397079 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:03.399191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:03.400653 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f7a4bf81-0873-4aa3-adf6-1b9f3ebea289 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.180618 Aug 12 10:57:03.401345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 437/839] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:03 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:03.891146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:03.892099 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:03.912997 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:03.913501 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:03.913938 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:03.914647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:03.915102 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:03.915533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:04.008529 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lazy-loading 'services' on Instance uuid dd97bb25-90c4-4774-bd6c-e345bc6ae17f {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:57:04.091525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b71e7e50-cc96-4838-8c3a-d82a17d6e8a5 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments/dbbaf3f2-da3d-4c2d-b924-7225331a18da" status: 202 len: 0 microversion: 2.1 time: 0.205967 Aug 12 10:57:04.092138 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 403/840] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:57:03 2022] DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments/dbbaf3f2-da3d-4c2d-b924-7225331a18da => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:04.102255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:04.104600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:04.111483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:04.112009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:04.112499 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:04.113495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:04.114025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:04.114646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:04.145086 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4b7992a2-ff68-4b16-8930-923bd9829d01 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046719 Aug 12 10:57:04.145668 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 438/841] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:04 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:04.435520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:04.436706 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:04.445103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:04.445591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:04.446028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:04.446719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:04.447172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:04.447598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:04.582994 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:04.594937 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:04.597438 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:04.598346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7313a01d-081b-488b-8bc2-adef0950b7f6 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.170841 Aug 12 10:57:04.598901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 404/842] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:04 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:05.161594 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:05.164487 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:05.172436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:05.172967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:05.173439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:05.174199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:05.174686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:05.175197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:05.207629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0e2d9507-011b-465a-914e-2a39bb9b53e1 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051884 Aug 12 10:57:05.208083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 439/843] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:05 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:05.513059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "name": "network-vif-plugged", "status": "completed", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:05.524686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:05.525182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:05.525782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:05.537104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] Creating event network-vif-plugged:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:57:05.542029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-b6c5d15c-5264-4182-b4c6-ae8fd9d8aedd req-67886ca4-5395-4d8d-9a71-d1c573c72bd0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Aug 12 10:57:05.542622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 405/844] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:05.625042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:05.625042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:05.632521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:05.633075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:05.633515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:05.634307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:05.634929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:05.635757 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:05.808817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:05.817141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:05.818635 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:05.819814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-252b3e80-5138-495e-a170-d0bd80af7b87 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.200401 Aug 12 10:57:05.820409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 440/845] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:05 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:06.226877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:06.230755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:06.241325 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:06.241804 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:06.242244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:06.242936 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:06.243415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:06.243988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:06.273628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-02f0d8f8-b4b8-4dd7-a87f-3c9cc0132c04 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053565 Aug 12 10:57:06.274100 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 406/846] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:06 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:06.847367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:06.848186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:06.856038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:06.856552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:06.856984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:06.857670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:06.858118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:06.858536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:07.013258 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:07.021414 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:07.023101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:07.024790 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-4c74fea0-f823-4bd2-8681-076052305c99 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1730 microversion: 2.20 time: 0.184136 Aug 12 10:57:07.025325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 441/847] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:06 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:07.285845 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:07.288727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:07.291542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=36 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:07.296826 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:07.297410 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:07.297854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:07.298542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:07.298990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:07.299409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:07.331216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-09fa9592-0153-4850-9ea0-4dac81c4d29d tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049346 Aug 12 10:57:07.331955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 407/848] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:07 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:08.052226 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:08.053238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:08.057072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:08.066203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:08.066997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:08.067721 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:08.068920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:08.069668 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:08.070720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:08.210135 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:08.218469 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:08.219947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:08.221117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-32b399c6-bcd1-40f3-b426-305def2a5dc2 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1717 microversion: 2.20 time: 0.175645 Aug 12 10:57:08.221676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 442/849] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:08 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1717 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:08.348199 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:08.351772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:08.363595 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:08.364447 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:08.365176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:08.366337 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:08.367097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:08.368245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:08.397970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b374ec53-29aa-4416-af35-306ebae32e35 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056365 Aug 12 10:57:08.399405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 408/850] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:08 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:09.410754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:09.412969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:09.421185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:09.421666 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:09.422071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:09.422796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:09.423241 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:09.423657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:09.456098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d492f1ae-830e-4c03-aade-eba520bd1110 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049248 Aug 12 10:57:09.456616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 443/851] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:09 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:10.386694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:10.396183 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:10.396699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:10.397224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:10.467295 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Going to try to stop instance {{(pid=132239) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 10:57:10.470123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:10.472304 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:10.479118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:10.479597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:10.480028 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:10.480746 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:10.481194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:10.481609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:10.512344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-21bc7faa-b319-4393-a032-557c9b36e3a4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Aug 12 10:57:10.516294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 444/852] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:10 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:10.516942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d7496751-2543-46ec-a5e9-c041cef9fd08 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.134470 Aug 12 10:57:10.517633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 409/853] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:57:10 2022] POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:10.526759 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:10.527366 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:10.533650 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:10.534218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:10.534775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:10.535715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:10.536217 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:10.536704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:10.670853 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:10.679297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b1b5e4be-dc57-48b8-9dd4-992ddba44309 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.157579 Aug 12 10:57:10.679855 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 445/854] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:10 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:11.529146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:11.531409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:11.538199 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.538632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.539048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.539735 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.540182 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.540638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.573852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cc11bb91-f3eb-4163-83eb-7e3accce142e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051272 Aug 12 10:57:11.574427 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 410/855] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:57:11 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:57:11.639039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:11.639593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:11.646358 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.646841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.647283 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.648129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.648957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.649379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.674417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:57:11.689040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:11.702028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:11.702775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:11.709212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.709834 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.710345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.711135 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.711736 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.712219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.767210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f5948330-6366-44eb-a8a4-a7e08fe6565f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 204 len: 0 microversion: 2.1 time: 0.131516 Aug 12 10:57:11.768138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 446/856] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:11 2022] DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:57:11.778707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:11.779515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:11.786311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.786923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.787935 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.788343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:11.788845 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:11.789392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:11.927398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:11.936413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-fa2b5a35-c4c6-4f7a-a3d5-731867661bdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.239836 Aug 12 10:57:11.937213 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 411/857] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:11 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:11.953926 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:11.961780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3cac2211-db0f-49f0-8fd5-714314bf68d4 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1681 microversion: 2.1 time: 0.188910 Aug 12 10:57:11.962576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 447/858] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:11 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:12.958758 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:12.959386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:12.968128 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:12.968640 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:12.969069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:12.969771 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:12.970252 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:12.970698 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:12.983326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:12.984027 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:12.990665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:12.991191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:12.991630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:12.992338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:12.992850 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:12.993270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:13.167052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:13.175173 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:13.176088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3a802aed-a1fd-4628-9f16-78516db0838a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.221296 Aug 12 10:57:13.176762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 412/859] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:12 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:13.184961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3f4894cf-363d-4d44-bf19-5db5724dfe1e tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1681 microversion: 2.1 time: 0.205692 Aug 12 10:57:13.185541 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 448/860] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:12 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1681 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:14.197788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:14.198569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:14.205256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:14.205749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:14.206024 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:14.206462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:14.206608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:14.206901 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:14.207347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:14.207781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:14.213054 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:14.213644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:14.214071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:14.214770 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:14.215266 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:14.215687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:14.305627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d5ff60d4b24fe0bbd771e8ed97db2f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362a04e0181b4fa49e27fb38c04ac677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:14.314441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-51f8655a-1ae0-4963-aad9-b01a44011661 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 200 len: 1613 microversion: 2.1 time: 0.112742 Aug 12 10:57:14.315660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 449/861] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:14 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:14.376693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:14.385189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-65c38a99-f9e8-4fdb-b761-b5e2586720ac tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.191513 Aug 12 10:57:14.385778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 413/862] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:14 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:14.693106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd97bb25-90c4-4774-bd6c-e345bc6ae17f", "name": "network-vif-deleted", "tag": "eae1eea5-3aff-4f74-9056-7b6614cacadf"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:14.704423 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:14.704897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:14.705336 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:14.718253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] Creating event network-vif-deleted:eae1eea5-3aff-4f74-9056-7b6614cacadf for instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f on hv-cinder-85294 Aug 12 10:57:14.724470 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-ea599bf0-0dab-408c-907d-845b08aba55c req-98f243cc-2942-47b0-abe1-2edd24638677 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034658 Aug 12 10:57:14.725017 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 450/863] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:15.141503 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:15.142005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:15.148852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.149358 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.149787 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.150647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.151107 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.151545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.180658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:57:15.280680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-be923a9d-4758-4001-a3ad-f989ea39473e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 204 len: 0 microversion: 2.1 time: 0.142934 Aug 12 10:57:15.281676 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 414/864] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:15 2022] DELETE /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:57:15.290649 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:15.291516 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:15.298592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.299079 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.299514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.300320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.300789 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.301389 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.337903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:15.338624 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:15.348453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.348953 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.349394 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.350142 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.350594 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.351027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.366955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f HTTP/1.1 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:15.368667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:15.370177 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'dd97bb25-90c4-4774-bd6c-e345bc6ae17f'} Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:15.370974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:15.372309 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:15.373504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:15.373504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8cf9e127-5ffa-4e0c-b28c-46f70b16ea80 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 404 len: 111 microversion: 2.1 time: 0.037796 Aug 12 10:57:15.373504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 415/865] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:15 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:57:15.379840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-4dc53cbe-e01c-45bd-8b99-9d5d0e325e34 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '.version_select at 0x7efc5c839430>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:15.406596 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-4dc53cbe-e01c-45bd-8b99-9d5d0e325e34 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841751473" status: 202 len: 0 microversion: 2.1 time: 0.029690 Aug 12 10:57:15.407290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 416/866] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Aug 12 10:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841751473 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:15.416354 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:15.417111 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:15.423929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.424716 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.425412 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.426426 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:15.427091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:15.427709 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:15.466620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:15.475556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7f7ec5ba-5bfd-4d0f-982e-bf51f12cf877 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1576 microversion: 2.1 time: 0.189100 Aug 12 10:57:15.476854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 451/867] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:15 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:15.575799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:15.589615 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7b159d1c-76a2-48c8-acb1-73d8ee84c867 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.181191 Aug 12 10:57:15.590209 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 417/868] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:15 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:16.497882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:16.498505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:16.505106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:16.505593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:16.506026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:16.506716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:16.507162 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:16.507582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:16.611781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:16.612432 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:16.619694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:16.620174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:16.620846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:16.621621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:16.622108 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:16.622533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:16.641361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:16.647735 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:16.656216 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-84c18533-dfce-4750-b781-fcd1f59f5d39 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1576 microversion: 2.1 time: 0.162426 Aug 12 10:57:16.657019 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 452/869] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:16 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:16.754622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:16.763113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9eba6693-e241-4da5-ba02-c540b105e8fe tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.155809 Aug 12 10:57:16.763695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 418/870] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:16 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:17.235322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:17.235966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:17.242290 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.242851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.243356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.244124 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.244692 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.245188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.258964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f HTTP/1.1 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:17.260817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.262787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'dd97bb25-90c4-4774-bd6c-e345bc6ae17f'} Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:17.263687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.265130 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.266350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:17.266350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-322492f0-5b6d-4289-aeb6-07432a6acbb8 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 404 len: 111 microversion: 2.1 time: 0.031785 Aug 12 10:57:17.266350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 453/871] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:17 2022] DELETE /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:17.273080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:17.274030 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: dd97bb25-90c4-4774-bd6c-e345bc6ae17f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:17.280379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.280869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.281307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.282011 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.282467 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.282898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.296328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f HTTP/1.1 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:17.297934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.300087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'dd97bb25-90c4-4774-bd6c-e345bc6ae17f'} Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:17.300941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. Aug 12 10:57:17.302153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:17.303284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance dd97bb25-90c4-4774-bd6c-e345bc6ae17f could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:17.303284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3522e317-cb21-4ab0-9086-0b7370afafc2 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f" status: 404 len: 111 microversion: 2.1 time: 0.030200 Aug 12 10:57:17.303284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 419/872] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:17 2022] GET /compute/v2.1/servers/dd97bb25-90c4-4774-bd6c-e345bc6ae17f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:17.678080 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:17.678925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:17.686305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.686803 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.687398 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.688178 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.688664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.689222 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.755258 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:17.763845 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b754739a-a49e-4758-83c6-2c3933146e98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1508 microversion: 2.1 time: 0.089645 Aug 12 10:57:17.764438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 454/873] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:17 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1508 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:17.792095 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:17.792850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:17.801216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.801824 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.802269 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.803157 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.804080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.804184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.860306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df47fd0a-3b8e-455b-9302-3f965672841c", "name": "network-vif-deleted", "tag": "807c08e2-d21a-4e62-9fbc-8381f80cc0bd"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:17.872454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:17.872957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:17.873424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:17.884916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] Creating event network-vif-deleted:807c08e2-d21a-4e62-9fbc-8381f80cc0bd for instance df47fd0a-3b8e-455b-9302-3f965672841c on hv-cinder-85294 Aug 12 10:57:17.890106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-83a498d0-fe33-446e-bbb4-3e0794aeab66 req-3d636dd5-2b49-4f96-84c1-3696d730188e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033637 Aug 12 10:57:17.890717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 455/874] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:57:17.987938 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:18.000675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c6bb2dd0-0bc4-42d1-865f-73b18718c506 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.212894 Aug 12 10:57:18.001497 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 420/875] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:17 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:57:18.456916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:18.457495 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:18.463677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.464163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.464701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.465398 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.466032 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.466456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.480667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd HTTP/1.1 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:18.482356 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.483955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'd2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd'} Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:18.484880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.486265 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.487625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:18.487625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8719ac72-89e3-4e09-b42b-6eb4f9826264 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 404 len: 111 microversion: 2.1 time: 0.031131 Aug 12 10:57:18.487625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 456/876] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:18 2022] DELETE /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:18.492598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:18.493407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:18.499536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.500029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.500491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.501195 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.501649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.502072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.515367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd HTTP/1.1 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:18.516954 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.518533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'd2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd'} Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:18.519352 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. Aug 12 10:57:18.520792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.522067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:18.522067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8a2c6900-972d-4809-a493-4156c065082f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd" status: 404 len: 111 microversion: 2.1 time: 0.029709 Aug 12 10:57:18.522067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 421/877] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:18 2022] GET /compute/v2.1/servers/d2236ee8-3fcc-4e1d-8b0d-a9f97b791bfd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 12 10:57:18.528436 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:18.528942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:18.535630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.536125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.536618 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.537335 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.537783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.538209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.554748 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f HTTP/1.1 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:18.556332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.557678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'da711dd0-ec6b-4b9c-ac84-72f961b0950f'} Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:18.558859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.560698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.562131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:18.562131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-aa801c15-90e1-4b1a-8a0b-554cda0e26b3 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 404 len: 111 microversion: 2.1 time: 0.034467 Aug 12 10:57:18.562131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 457/878] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:18 2022] DELETE /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:18.567702 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:18.568335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: da711dd0-ec6b-4b9c-ac84-72f961b0950f] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:18.574921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.575404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.575837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.576567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.577018 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.577440 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.591819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f HTTP/1.1 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:18.593357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.594914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'da711dd0-ec6b-4b9c-ac84-72f961b0950f'} Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:18.595841 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. Aug 12 10:57:18.597433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:18.599633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance da711dd0-ec6b-4b9c-ac84-72f961b0950f could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:18.599633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-11a0c07a-fa3b-4c3b-a2bd-af6460e4190f tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f" status: 404 len: 111 microversion: 2.1 time: 0.031010 Aug 12 10:57:18.599633 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 422/879] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:18 2022] GET /compute/v2.1/servers/da711dd0-ec6b-4b9c-ac84-72f961b0950f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:18.786119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:18.786885 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:18.793403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.793890 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.794324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.795115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.795632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.796352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.828731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:18.829221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:18.829655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:18.830172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lazy-loading 'fault' on Instance uuid df47fd0a-3b8e-455b-9302-3f965672841c {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:57:18.875576 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:18.882799 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ae26d3fc-c5ca-4a64-8d74-3b15206e6aff tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 200 len: 1184 microversion: 2.1 time: 0.101024 Aug 12 10:57:18.883368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 458/880] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:18 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 1184 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:19.022212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:19.023275 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:19.033944 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.034435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.034869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.035568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.036021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.036487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.182381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:19.195697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-80681a36-affe-4114-b0ae-f77c3c0a72a4 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.177342 Aug 12 10:57:19.196593 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 423/881] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:19 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:19.757595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:19.758069 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:19.764548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.765026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.765459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.766172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.766616 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.767037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.780676 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 HTTP/1.1 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:19.782249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.783784 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '50312e28-f052-47cc-88c5-34ac69ff9551'} Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:19.784680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.785942 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.787882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:19.787882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-109e25f3-e952-4d38-bc19-d2a15bcff260 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 404 len: 111 microversion: 2.1 time: 0.029960 Aug 12 10:57:19.787882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 459/882] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:57:19 2022] DELETE /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:19.792152 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:19.793021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] [instance: 50312e28-f052-47cc-88c5-34ac69ff9551] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:19.798848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.799323 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.799759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.800477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.800920 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.801370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.814524 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] HTTP exception thrown: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Request method failure captured: Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 HTTP/1.1 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB00b8enSjfrryw3nsMRs_q019xtkCps4Yj0e0qBYwALhiC6zyrJ53eeSl-a9I0ZveK1xzYzLiV1OSL-D-xoaqJpPvw60-EHPuYPc01PpC945-Ae0cp_fSjML6EQHWYWjom4Z_ZSUakowAlWUqB9RRUeSDI66tnPLYyTUTOhon3zho Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:19.816026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_362a04e0181b4fa49e27fb38c04ac677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/362a04e0181b4fa49e27fb38c04ac677"}]}] Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 362a04e0181b4fa49e27fb38c04ac677 Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464623893 Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: e0d5ff60d4b24fe0bbd771e8ed97db2f Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeNegativeTest-1464623893-project Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.817729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '50312e28-f052-47cc-88c5-34ac69ff9551'} Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:19.818745 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. Aug 12 10:57:19.820172 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.821612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] Returning 404 to user: Instance 50312e28-f052-47cc-88c5-34ac69ff9551 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:19.821612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-43c14091-a677-4020-aabe-c69d5fbfd632 tempest-AttachVolumeNegativeTest-1464623893 tempest-AttachVolumeNegativeTest-1464623893-project] 10.222.0.23 "GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551" status: 404 len: 111 microversion: 2.1 time: 0.029142 Aug 12 10:57:19.821612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 424/883] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:19 2022] GET /compute/v2.1/servers/50312e28-f052-47cc-88c5-34ac69ff9551 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:19.905598 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:19.906210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:19.912693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.913190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.913603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.914298 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:19.914737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:19.915156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:19.928437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] HTTP exception thrown: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Request method failure captured: Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c HTTP/1.1 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jFArV6E_NfUe50aUcuEa1PqnTkNf6ATPt8c4yRp_LwD4wuQZVsUVohC-o2nPIfx0T9AUzg9v0KzDo7153fbRp-G_P9wabUNdutbUd4ONlpbT8hclff6Yyw7WzD3__Gp3YPNrqocAbQpOTGV1vI0FDRCZcNN8SBJuf85oP59PKKaaz0 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 89943304402242278f5614ea5bde6092 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:19.929937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89943304402242278f5614ea5bde6092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89943304402242278f5614ea5bde6092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}] Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestVolumeBootPattern-513807962 Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 89943304402242278f5614ea5bde6092 Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestVolumeBootPattern-513807962-project Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 922f49fa7d324ebdade043e1be1a476f Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestVolumeBootPattern-513807962-project Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 10:57:19.931300 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'df47fd0a-3b8e-455b-9302-3f965672841c'} Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:19.932129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 10:57:19.933392 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:19.934647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Returning 404 to user: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:19.934647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-32dd055c-84db-4ea5-866a-60dc645bdda4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 404 len: 111 microversion: 2.1 time: 0.029702 Aug 12 10:57:19.934647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 460/884] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:19 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:20.040525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2135724681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902672255", "security_groups": [{"name": "tempest-secgroup-smoke-1804087682"}], "block_device_mapping_v2": [{"uuid": "a38c3bb6-9367-4f7a-a742-3f422a1551a2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5449083c-84b0-405b-91f7-10223968ec01"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:20.210850 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] validate_networks() for [('5449083c-84b0-405b-91f7-10223968ec01', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:57:20.219094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:20.219798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:20.226828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:20.227297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:20.227727 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:20.228475 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:20.228923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:20.229338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:20.764046 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:20.772861 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-09fde8a4-a512-483d-acf5-8fad0e275459 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.558177 Aug 12 10:57:20.773768 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 461/885] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:20 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:21.235267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:57:21.235728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:57:21.236147 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:57:21.236585 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:57:21.236993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:57:21.246610 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:21.247090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:21.247526 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:21.248293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:21.249003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:21.249431 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:21.267097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:57:21.271289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for user 922f49fa7d324ebdade043e1be1a476f and project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:57:21.330832 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:57:21.334960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a38c3bb6-9367-4f7a-a742-3f422a1551a2',volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:57:21.475103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-055fa13e-90d4-47db-b448-a67a3ddfc023 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.438534 Aug 12 10:57:21.476057 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 425/886] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:57:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:57:21.487460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ab835baf-397b-4170-8a20-0a3cc185a45f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:21.488029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ab835baf-397b-4170-8a20-0a3cc185a45f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:21.572379 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ab835baf-397b-4170-8a20-0a3cc185a45f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:21.581568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ab835baf-397b-4170-8a20-0a3cc185a45f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1094 microversion: 2.1 time: 0.097979 Aug 12 10:57:21.582422 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 462/887] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:21 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:57:21.794885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:21.795601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:21.802342 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:21.802831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:21.803270 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:21.803965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:21.804628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:21.805054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:22.043082 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:22.052664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-61981b9d-e5c5-4aab-85dc-cd8ea298f52d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.262095 Aug 12 10:57:22.053493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 426/888] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:21 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:22.604137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:22.606219 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:22.614785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:22.615560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:22.616201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:22.617395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:22.618033 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:22.618679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:22.738828 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:22.761815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7ee318df-f0ae-488f-aab4-17c2e680bf98 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1200 microversion: 2.1 time: 0.162821 Aug 12 10:57:22.763364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 463/889] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:22 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1200 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:23.076927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:23.082916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:23.090294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:23.091171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:23.091855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:23.092840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:23.093677 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:23.094405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:23.409814 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:23.423415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-596e9dfd-b0f6-43b3-b508-945642ecc339 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.350854 Aug 12 10:57:23.427360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 427/890] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:23 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:23.787547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:23.788797 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:23.798786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:23.799600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:23.800427 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:23.801345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:23.801953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:23.802504 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:24.114731 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:24.126557 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d3f94b6c-f322-4db9-a7a2-2a419213171e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.343037 Aug 12 10:57:24.128246 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 464/891] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:23 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:24.271155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc13a20-172f-4e2b-9b50-deeb09bb9f5c", "tag": "412d82f6-0ea3-41fd-8ac5-5fa4a071ecab"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:24.286414 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:24.288059 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:24.289232 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:24.320347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] Creating event network-changed:412d82f6-0ea3-41fd-8ac5-5fa4a071ecab for instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c on hv-cinder-85294 Aug 12 10:57:24.330803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-9282ad6d-45dc-494a-bb71-f2f28e928b9c req-d08b4b93-e1be-4f12-a713-e6fb6b2f9d93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063225 Aug 12 10:57:24.333192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 428/892] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:24.447897 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:24.448537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:24.456510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:24.457719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:24.458307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:24.459210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:24.459825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:24.460305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:24.702708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:24.713031 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1a3298ba-4a53-4ad1-bd4e-aeada9aa108e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.270088 Aug 12 10:57:24.713631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 465/893] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:24 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:25.149589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:25.150525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:25.157688 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:25.158189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:25.158671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:25.159688 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:25.160149 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:25.160780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:25.316727 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:25.326499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b323e79e-21ab-4d29-a8df-16ff54d3ae6f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.181164 Aug 12 10:57:25.327479 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 429/894] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:25 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:25.734297 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:25.735065 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:25.741160 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:25.741640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:25.742094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:25.742763 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:25.743210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:25.743630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:25.874164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:25.882638 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-57634602-ac88-466b-9164-bede71bf8fe6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1723 microversion: 2.1 time: 0.152792 Aug 12 10:57:25.883199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 466/895] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:25 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:26.346995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:26.347616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:26.354086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:26.354571 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:26.355165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:26.355871 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:26.356442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:26.356874 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:26.494597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:26.504513 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-db5d7f83-10f0-41dd-82ff-22e4ca7bfa07 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.160790 Aug 12 10:57:26.505119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 430/896] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:26 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:26.905089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:26.905697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:26.912231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:26.912741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:26.913175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:26.913876 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:26.914330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:26.914755 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:26.932878 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:27.047961 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:27.056308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-afcd0a04-41ce-4a74-8b39-ad0e7378d89a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1700 microversion: 2.1 time: 0.155207 Aug 12 10:57:27.056894 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 467/897] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:26 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:27.077012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:27.083444 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:27.083930 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:27.084426 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:27.113336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Going to try to start instance {{(pid=132239) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 10:57:27.166493 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0dda90fb-bebc-40a0-a096-36f727bd2c69 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.093226 Aug 12 10:57:27.167780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 431/898] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:57:27 2022] POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:27.176442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:27.177309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:27.183822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:27.184408 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:27.185051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:27.186220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:27.186734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:27.187222 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:27.334092 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:27.344515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-00643d88-43da-404c-9a38-a5c32aa35611 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1709 microversion: 2.1 time: 0.172609 Aug 12 10:57:27.345376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 468/899] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:27 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:27.527590 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:27.528416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:27.534974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:27.535459 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:27.535877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:27.536608 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:27.537058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:27.537516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:27.679815 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:27.689148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-066dd3d1-04fc-43a3-a6ea-86c973ac611e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.167229 Aug 12 10:57:27.703171 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 432/900] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:27 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:28.366119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:28.366717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:28.373742 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:28.374120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:28.374559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:28.375247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:28.375703 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:28.376127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:28.521512 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:28.530636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9df6df5e-45ae-4781-9800-031ed7848e2a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1709 microversion: 2.1 time: 0.168420 Aug 12 10:57:28.531310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 469/901] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:28 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:28.709967 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:28.710609 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:28.718117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:28.718606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:28.719042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:28.719742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:28.720198 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:28.720661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:28.857916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:28.866523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-562d4d06-dcdc-4a66-be50-05f8094a7b3a tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.160239 Aug 12 10:57:28.866927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 433/902] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:28 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:29.551459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:29.552104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:29.560119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:29.560641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:29.561181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:29.561917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:29.562365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:29.562854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:29.699009 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:29.706970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-eb5b7d8b-5688-4662-bb5d-d4b0b7bac4cc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1713 microversion: 2.1 time: 0.159695 Aug 12 10:57:29.707524 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 470/903] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:29 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:29.887446 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:29.888148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:29.895445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:29.895935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:29.896397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:29.897138 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:29.897730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:29.898158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:30.045558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:30.053239 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a39073ee-fd0c-4a8c-8c31-6e8d735b972b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.169934 Aug 12 10:57:30.053863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 434/904] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:29 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:31.073891 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:31.074603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:31.081403 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:31.081891 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:31.082329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:31.083008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:31.083758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:31.084185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:31.226508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:31.234118 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-01fbdad7-3c3c-4d00-90a3-09841b81d917 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.164108 Aug 12 10:57:31.234657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 471/905] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:31 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:32.256041 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:32.257021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:32.259290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:32.259936 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:32.266187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:32.266674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:32.267158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:32.267884 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:32.268386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:32.268810 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:32.409090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:32.420399 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1f52d9a0-6af6-4870-8dc4-871dbe2e6feb tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.168345 Aug 12 10:57:32.421258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 435/906] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:32 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:33.446133 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:33.446729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:33.448899 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:33.454560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:33.455357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:33.455779 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:33.456982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:33.458127 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:33.458767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:33.585012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc13a20-172f-4e2b-9b50-deeb09bb9f5c", "name": "network-vif-plugged", "status": "completed", "tag": "412d82f6-0ea3-41fd-8ac5-5fa4a071ecab"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:33.596607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:33.597429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:33.597882 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:33.610041 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:33.618895 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7f5f84b3-f8b2-427e-a685-0f8637ab0b91 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.176603 Aug 12 10:57:33.619472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 472/907] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:33 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:33.625078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] Creating event network-vif-plugged:412d82f6-0ea3-41fd-8ac5-5fa4a071ecab for instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c on hv-cinder-85294 Aug 12 10:57:33.632023 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-4a1e3709-b993-4716-bd1f-1e7a9277dc8c req-2b4829b9-06dc-48c5-83ab-6df4ed2075ae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056537 Aug 12 10:57:33.633195 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 436/908] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:34.640887 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:34.641515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:34.648175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:34.649052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:34.649491 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:34.650198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:34.650657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:34.651081 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:34.790461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:34.798282 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a2e9d178-24c7-4a6f-997a-69662cf821e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1266 microversion: 2.1 time: 0.161620 Aug 12 10:57:34.798907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 473/909] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:34 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:35.822389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:35.823224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:35.830163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:35.830663 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:35.831110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:35.831819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:35.832299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:35.832740 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:35.978581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:35.986454 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-843d5b60-6875-48db-8731-90d2a1485315 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1453 microversion: 2.1 time: 0.170646 Aug 12 10:57:35.987032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 437/910] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:35 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:36.007425 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:36.008327 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:36.016734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:36.017235 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:36.017675 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:36.018383 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:36.018834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:36.019292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:36.160687 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:36.169008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f0387b76-97a9-4862-90d2-b42c85059d21 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1453 microversion: 2.1 time: 0.165428 Aug 12 10:57:36.169955 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 474/911] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:57:36 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:37.870361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc13a20-172f-4e2b-9b50-deeb09bb9f5c", "tag": "412d82f6-0ea3-41fd-8ac5-5fa4a071ecab"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:37.879002 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:37.883462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:37.884200 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:37.884831 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:37.898517 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] Creating event network-changed:412d82f6-0ea3-41fd-8ac5-5fa4a071ecab for instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c on hv-cinder-85294 Aug 12 10:57:37.904506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-7f8c423a-58a7-430f-bd0f-63c697ef3ef8 req-9d2d676b-0515-482d-a2f9-eec60e429652 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038136 Aug 12 10:57:37.905965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 438/912] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 10:57:41.150472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:41.152720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:41.155454 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:41.160740 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.161409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.161667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.162345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.162794 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.163212 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.194680 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f70c02e8-6faa-42db-9b66-cce68d83aafc tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047998 Aug 12 10:57:41.195641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 475/913] 10.222.0.23 () {60 vars in 1343 bytes} [Fri Aug 12 10:57:41 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:57:41.262318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:41.262897 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:41.269671 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.270151 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.270598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.271289 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.271742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.272156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.291644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:41.300462 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:57:41.387928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f3aeb93b-6052-4fea-b9db-a033cd33cf1b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 204 len: 0 microversion: 2.20 time: 0.130698 Aug 12 10:57:41.388659 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 439/914] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Aug 12 10:57:41 2022] DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 10:57:41.397102 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:41.397708 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:41.404210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.405375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.405818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.406516 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:41.406966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:41.407395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:41.548977 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:41.557064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:41.558609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:41.559773 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f285b2fa-af59-4b0e-901d-186a6a0fa06b tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.166558 Aug 12 10:57:41.571562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 476/915] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:41 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:42.582985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:42.583735 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:42.590491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:42.590976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:42.591409 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:42.592598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:42.593049 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:42.593487 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:42.731317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:42.739934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:42.741476 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:42.742652 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c33824d1-a23f-4b56-85e8-e811ad7c9c55 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1723 microversion: 2.20 time: 0.164056 Aug 12 10:57:42.743210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 440/916] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:42 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:43.765424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:43.766025 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:43.772661 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:43.773140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:43.773586 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:43.774593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:43.775032 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:43.775621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:43.846421 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:43.857255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:43.858854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c0711a144b4c4432ab849367d3bd2b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3cc44ffed94a428ab9e49ebb3854e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:57:43.860625 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1286cb31-4714-48d3-9c91-37911964af5d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 200 len: 1657 microversion: 2.20 time: 0.098710 Aug 12 10:57:43.860723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 477/917] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:43 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 1657 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 12 10:57:44.282302 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc2ad53-5ae4-4b77-82a3-9dfb157131b5", "name": "network-vif-deleted", "tag": "9751d1ba-4ee0-4491-bba4-6291f0d09576"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:44.296879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:44.297374 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:44.297857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:44.313144 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] Creating event network-vif-deleted:9751d1ba-4ee0-4491-bba4-6291f0d09576 for instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 on hv-cinder-85294 Aug 12 10:57:44.319339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-bdb522d8-233f-4bde-8b02-3d1dbd93b7f2 req-5a9715e5-4c88-47ee-a663-b7293c3b401e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041389 Aug 12 10:57:44.319950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 441/918] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:44.883936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:44.884584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:44.891083 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:44.891857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:44.892292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:44.893026 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:44.893479 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:44.893907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:44.908274 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 HTTP/1.1 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:44.909872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:44.911572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '9bc2ad53-5ae4-4b77-82a3-9dfb157131b5'} Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:44.912483 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:44.913904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:44.915062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:44.915062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3e3bf630-d3a5-429c-b535-8e9e62db265e tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 404 len: 111 microversion: 2.20 time: 0.031700 Aug 12 10:57:44.915062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 478/919] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:44 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:57:44.921104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-48757594-0338-4beb-b667-3c2ccfd4bf5f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '.version_select at 0x7efc5ca0d1f0>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:44.941697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-48757594-0338-4beb-b667-3c2ccfd4bf5f tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931051763" status: 204 len: 0 microversion: 2.20 time: 0.024816 Aug 12 10:57:44.942286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 442/920] 10.222.0.23 () {60 vars in 1259 bytes} [Fri Aug 12 10:57:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931051763 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 12 10:57:46.749689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:46.750213 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:46.757090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:46.757569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:46.758000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:46.758682 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:46.759101 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:46.759537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:46.773149 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 HTTP/1.1 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:46.775142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.776711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '9bc2ad53-5ae4-4b77-82a3-9dfb157131b5'} Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:46.780931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.782369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.783707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:46.783707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a12120ef-20c0-4e42-bd2c-2eae203bbd1d tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 404 len: 111 microversion: 2.20 time: 0.030843 Aug 12 10:57:46.783707 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 479/921] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Aug 12 10:57:46 2022] DELETE /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 12 10:57:46.790369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:46.791121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:46.798054 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:46.798627 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:46.799482 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:46.800187 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:46.800695 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:46.801119 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:46.814318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 HTTP/1.1 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:46.816042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.817724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '9bc2ad53-5ae4-4b77-82a3-9dfb157131b5'} Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:46.818742 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. Aug 12 10:57:46.820248 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:46.821741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:46.821741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-02a14ae0-bb44-4c72-84ad-08bdd863a793 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5" status: 404 len: 111 microversion: 2.20 time: 0.032153 Aug 12 10:57:46.821959 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 443/922] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:46 2022] GET /compute/v2.1/servers/9bc2ad53-5ae4-4b77-82a3-9dfb157131b5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:57:47.965818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:47.966321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:47.973071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:47.973556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:47.974011 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:47.974705 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:47.975190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:47.975734 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:47.990526 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a HTTP/1.1 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:57:47.992242 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:47.993984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '8c63996f-78ad-46b1-8b3b-3fb94a73556a'} Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:47.994817 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:47.996278 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:57:47.998321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:47.998321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e80764c7-44ee-4565-9ef4-19864000e0b1 tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 404 len: 111 microversion: 2.20 time: 0.031642 Aug 12 10:57:47.998321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 480/923] 10.222.0.23 () {60 vars in 1280 bytes} [Fri Aug 12 10:57:47 2022] DELETE /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:57:48.004168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:48.004819 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] [instance: 8c63996f-78ad-46b1-8b3b-3fb94a73556a] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:57:48.013051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:48.013542 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:48.013984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:48.014722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:57:48.015285 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:57:48.015716 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:57:48.029951 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] HTTP exception thrown: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Request method failure captured: Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a HTTP/1.1 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jB5WaukciO0V8_DQOm2GXgECH1PoIqBUMutnuU903g4uE6ayH7y86g9u6yIs-47aYsQEPTSW3seTICuS1EqueP4ceRL10zY6iNTEjM9802wPEfosFCqTxEA9DmKGFkF8S8aTpkPzEmGdxC_D_HhN1f-txim6GUXmdkqG3DVMjs_OGY Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Openstack-Nova-Api-Version: 2.20 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:48.031534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1d3cc44ffed94a428ab9e49ebb3854e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1d3cc44ffed94a428ab9e49ebb3854e0"}]}] Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 1d3cc44ffed94a428ab9e49ebb3854e0 Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-277886555 Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: c0711a144b4c4432ab849367d3bd2b33 Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeShelveTestJSON-277886555-project Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:48.033228 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '8c63996f-78ad-46b1-8b3b-3fb94a73556a'} Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:48.033971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. Aug 12 10:57:48.035207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:48.036378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] Returning 404 to user: Instance 8c63996f-78ad-46b1-8b3b-3fb94a73556a could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:48.036378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-aadc4c5e-061e-4e3e-ae6b-67b1ddce98db tempest-AttachVolumeShelveTestJSON-277886555 tempest-AttachVolumeShelveTestJSON-277886555-project] 10.222.0.23 "GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a" status: 404 len: 111 microversion: 2.20 time: 0.034225 Aug 12 10:57:48.036378 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 444/924] 10.222.0.23 () {60 vars in 1277 bytes} [Fri Aug 12 10:57:47 2022] GET /compute/v2.1/servers/8c63996f-78ad-46b1-8b3b-3fb94a73556a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 12 10:57:53.439105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b52f2463-c311-4e50-89bb-d336d3e063c8 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Action: 'create', calling method: .version_select at 0x7efc61252790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-492921945"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:53.795729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b52f2463-c311-4e50-89bb-d336d3e063c8 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.545305 Aug 12 10:57:53.797292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 481/925] 10.222.0.23 () {60 vars in 1155 bytes} [Fri Aug 12 10:57:53 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 548 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 12 10:57:53.810268 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-bd7701fc-757b-4578-98c5-8aa1ca92cb23 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5c9d4b80>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:53.872295 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-bd7701fc-757b-4578-98c5-8aa1ca92cb23 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 200 len: 344 microversion: 2.1 time: 0.065889 Aug 12 10:57:53.872906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 445/926] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:57:53 2022] GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:54.887230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f2ea7b50-a84a-4a55-a98f-f9de50718420 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc611383a0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:54.946670 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f2ea7b50-a84a-4a55-a98f-f9de50718420 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 200 len: 345 microversion: 2.1 time: 0.064022 Aug 12 10:57:54.955207 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 482/927] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:57:54 2022] GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:54.962184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ba0d53b6-e623-4209-90db-0a17a2e2ac29 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Action: 'create', calling method: .version_select at 0x7efc5ca0d0d0>, body: {"snapshot": {"volume_id": "d9a5b7b2-7bb4-403d-8271-3db24a8e10cf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1554814715"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:55.192483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ba0d53b6-e623-4209-90db-0a17a2e2ac29 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.235892 Aug 12 10:57:55.193510 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 446/928] 10.222.0.23 () {60 vars in 1162 bytes} [Fri Aug 12 10:57:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:55.206240 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ccba7ce3-2e56-4672-b802-70dcc2b2aece tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc61194790>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:55.277280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ccba7ce3-2e56-4672-b802-70dcc2b2aece tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 287 microversion: 2.1 time: 0.076024 Aug 12 10:57:55.278148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 483/929] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:55 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:55.291129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5feaf671-67bb-4bb8-8be3-f9345a5928d2 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5ca0d4c0>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:55.346376 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5feaf671-67bb-4bb8-8be3-f9345a5928d2 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.060320 Aug 12 10:57:55.347618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 447/930] 10.222.0.23 () {58 vars in 1140 bytes} [Fri Aug 12 10:57:55 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:55.360186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-75748776-b6b4-4b36-b99d-0a78e97ad042 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc6120ba60>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:55.408429 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-75748776-b6b4-4b36-b99d-0a78e97ad042 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 287 microversion: 2.1 time: 0.053118 Aug 12 10:57:55.409006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 484/931] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:55 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:56.420563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-36800ef9-5b0a-4d47-9efc-33c767365661 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5ca26310>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:56.455272 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-36800ef9-5b0a-4d47-9efc-33c767365661 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 287 microversion: 2.1 time: 0.038637 Aug 12 10:57:56.456194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 448/932] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:56 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:57.470620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-58721907-0280-431a-a218-a1bb5adc0aa0 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc611d43a0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:57.531036 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-58721907-0280-431a-a218-a1bb5adc0aa0 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 287 microversion: 2.1 time: 0.065633 Aug 12 10:57:57.532106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 485/933] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:57 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:58.542883 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:58.543984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:58.551230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cea20541-3217-4fb7-839c-c33794f0796d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5c9ccf70>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:58.601168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cea20541-3217-4fb7-839c-c33794f0796d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 288 microversion: 2.1 time: 0.060760 Aug 12 10:57:58.614239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=11 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:58.616043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=68 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:57:58.619798 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 449/934] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:58 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:58.623409 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1d71ab4b-590b-499b-bde4-55e4dd74509d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5cbb8b80>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:58.728338 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1d71ab4b-590b-499b-bde4-55e4dd74509d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 202 len: 0 microversion: 2.1 time: 0.114667 Aug 12 10:57:58.737536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2ea44328-5f47-4fbe-b861-815b12e5d54c tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5ca26790>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:58.737940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 486/935] 10.222.0.23 () {58 vars in 1254 bytes} [Fri Aug 12 10:57:58 2022] DELETE /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:58.779034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2ea44328-5f47-4fbe-b861-815b12e5d54c tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 200 len: 287 microversion: 2.1 time: 0.045432 Aug 12 10:57:58.779601 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 450/936] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:58 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:59.013877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5bbd076c-1cb3-41da-9126-5eac896036fa tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Action: 'create', calling method: .version_select at 0x7efc61252e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-864958502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5IsFlwyrrMzMekiwGylxxMLIevft743GI7+lz+t/lhxeiSO381NInCvIX3NWWRcMeac8WjKfaA/asq3XNlLZFrsgIOmlBrJCqu1S9lipRESCY7lPUUdWHvF0RaovVf5w=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:57:59.030108 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-5bbd076c-1cb3-41da-9126-5eac896036fa tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Getting quotas for project fafc312df1404fc6bbc28415bb744411. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:57:59.034621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-5bbd076c-1cb3-41da-9126-5eac896036fa tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Getting quotas for user f16bdb81c5a249bb9f95e390dbd0dbfd and project fafc312df1404fc6bbc28415bb744411. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:57:59.058577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5bbd076c-1cb3-41da-9126-5eac896036fa tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.218244 Aug 12 10:57:59.059198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 487/937] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:57:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:57:59.792072 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-940244e2-a89c-4209-85ef-694ddd976694 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5c6cc550>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:59.831029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-940244e2-a89c-4209-85ef-694ddd976694 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] HTTP exception thrown: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-940244e2-a89c-4209-85ef-694ddd976694 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Request method failure captured: Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 HTTP/1.1 Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jIxfHsk3BrOj63epYbt4lIZfX7JH9YEAj_JDmutlYEWInCOocLcsOOYSFtFXxtOZ94PSiHoW56hQGI6RnyeR-DOPNOaerPrwFzZ5ySMAMpJI9ps7NK0amlGcqqfI9lh_dEmKWmVYL8HRpIp3B69nfz_983YVNPuEAWZHn1c7cDt2qo Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:57:59.833442 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}] Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 45f446d513e94ccba51391c7d6b03876 Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '2a290287-de6c-4300-83d8-dcacaf199477'} Aug 12 10:57:59.836657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. (HTTP 404) (Request-ID: req-1d354be0-029f-4f88-8447-e155a878bcd8) Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.838489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:57:59.841276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 12 10:57:59.842989 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-940244e2-a89c-4209-85ef-694ddd976694 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Returning 404 to user: Snapshot 2a290287-de6c-4300-83d8-dcacaf199477 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-940244e2-a89c-4209-85ef-694ddd976694 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477" status: 404 len: 111 microversion: 2.1 time: 0.047860 Aug 12 10:57:59.844682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 451/938] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 10:57:59 2022] GET /compute/v2.1/os-snapshots/2a290287-de6c-4300-83d8-dcacaf199477 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:57:59.845939 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e5d5d926-0706-4e3a-a566-50e2a6f3459c tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc6120b790>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:59.913362 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e5d5d926-0706-4e3a-a566-50e2a6f3459c tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 202 len: 0 microversion: 2.1 time: 0.072932 Aug 12 10:57:59.914323 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 488/939] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:57:59 2022] DELETE /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:57:59.922911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-33025f6a-4bce-4877-bb1e-c959a97d2ec1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5c732f70>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:57:59.979956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-33025f6a-4bce-4877-bb1e-c959a97d2ec1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 200 len: 344 microversion: 2.1 time: 0.061459 Aug 12 10:57:59.980536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 452/940] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:57:59 2022] GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:58:00.994812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8ee6d74b-111d-4c9b-abbb-c28c02da68dc tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc61131ee0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:01.031648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-8ee6d74b-111d-4c9b-abbb-c28c02da68dc tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] HTTP exception thrown: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8ee6d74b-111d-4c9b-abbb-c28c02da68dc tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Request method failure captured: Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf HTTP/1.1 Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jIxfHsk3BrOj63epYbt4lIZfX7JH9YEAj_JDmutlYEWInCOocLcsOOYSFtFXxtOZ94PSiHoW56hQGI6RnyeR-DOPNOaerPrwFzZ5ySMAMpJI9ps7NK0amlGcqqfI9lh_dEmKWmVYL8HRpIp3B69nfz_983YVNPuEAWZHn1c7cDt2qo Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:58:01.033824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}] Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 45f446d513e94ccba51391c7d6b03876 Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'd9a5b7b2-7bb4-403d-8271-3db24a8e10cf'} Aug 12 10:58:01.035439 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. (HTTP 404) (Request-ID: req-771b6b5e-36bc-4be2-b723-8513a402f28f) Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.036465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:58:01.037860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 10:58:01.041037 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8ee6d74b-111d-4c9b-abbb-c28c02da68dc tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Returning 404 to user: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:58:01.042545 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8ee6d74b-111d-4c9b-abbb-c28c02da68dc tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 404 len: 109 microversion: 2.1 time: 0.045249 Aug 12 10:58:01.046561 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 489/941] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:58:00 2022] GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:58:01.050586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-401dab58-5e05-4dbe-a734-cf15ebea639d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc5c799f70>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:01.081293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-401dab58-5e05-4dbe-a734-cf15ebea639d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] HTTP exception thrown: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-401dab58-5e05-4dbe-a734-cf15ebea639d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Request method failure captured: Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: DELETE /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf HTTP/1.1 Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jIxfHsk3BrOj63epYbt4lIZfX7JH9YEAj_JDmutlYEWInCOocLcsOOYSFtFXxtOZ94PSiHoW56hQGI6RnyeR-DOPNOaerPrwFzZ5ySMAMpJI9ps7NK0amlGcqqfI9lh_dEmKWmVYL8HRpIp3B69nfz_983YVNPuEAWZHn1c7cDt2qo Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 10:58:01.083305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}] Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 45f446d513e94ccba51391c7d6b03876 Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'd9a5b7b2-7bb4-403d-8271-3db24a8e10cf'} Aug 12 10:58:01.085090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. (HTTP 404) (Request-ID: req-ebb63218-ea48-4dc7-9fb0-467e3e4b86a0) Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.086093 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 12 10:58:01.087519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 12 10:58:01.088934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-401dab58-5e05-4dbe-a734-cf15ebea639d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Returning 404 to user: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-401dab58-5e05-4dbe-a734-cf15ebea639d tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 404 len: 109 microversion: 2.1 time: 0.038781 Aug 12 10:58:01.090328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 453/942] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 10:58:01 2022] DELETE /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:58:01.097119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-360fe45b-60c5-49fb-9ec1-d70c5875bfc1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Calling method '.version_select at 0x7efc611d4160>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:01.125883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-360fe45b-60c5-49fb-9ec1-d70c5875bfc1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] HTTP exception thrown: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-360fe45b-60c5-49fb-9ec1-d70c5875bfc1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Request method failure captured: Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf HTTP/1.1 Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jIxfHsk3BrOj63epYbt4lIZfX7JH9YEAj_JDmutlYEWInCOocLcsOOYSFtFXxtOZ94PSiHoW56hQGI6RnyeR-DOPNOaerPrwFzZ5ySMAMpJI9ps7NK0amlGcqqfI9lh_dEmKWmVYL8HRpIp3B69nfz_983YVNPuEAWZHn1c7cDt2qo Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:58:01.127908 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a952ae3bd5e14e39be82baa02aecf77d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a952ae3bd5e14e39be82baa02aecf77d"}]}] Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: a952ae3bd5e14e39be82baa02aecf77d Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-47658183 Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 45f446d513e94ccba51391c7d6b03876 Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-VolumesSnapshotsTestJSON-47658183-project Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'd9a5b7b2-7bb4-403d-8271-3db24a8e10cf'} Aug 12 10:58:01.129503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. (HTTP 404) (Request-ID: req-ec81039b-d88e-4eff-a3fe-f343e16a655c) Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.130476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 12 10:58:01.131886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 12 10:58:01.133589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-360fe45b-60c5-49fb-9ec1-d70c5875bfc1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] Returning 404 to user: Volume d9a5b7b2-7bb4-403d-8271-3db24a8e10cf could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-360fe45b-60c5-49fb-9ec1-d70c5875bfc1 tempest-VolumesSnapshotsTestJSON-47658183 tempest-VolumesSnapshotsTestJSON-47658183-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf" status: 404 len: 109 microversion: 2.1 time: 0.036863 Aug 12 10:58:01.134982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 490/943] 10.222.0.23 () {58 vars in 1245 bytes} [Fri Aug 12 10:58:01 2022] GET /compute/v2.1/os-volumes/d9a5b7b2-7bb4-403d-8271-3db24a8e10cf => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:58:08.249036 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:08.249650 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:08.256551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:08.257034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:08.257469 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:08.258161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:08.258648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:08.259080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:08.339052 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lazy-loading 'services' on Instance uuid 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:58:08.422712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c98a72de-f11d-40b2-bced-b1e5aa1f6457 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments/541649eb-10e5-4fc0-8221-50f0a2330ba5" status: 202 len: 0 microversion: 2.1 time: 0.178939 Aug 12 10:58:08.423299 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 454/944] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 10:58:08 2022] DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments/541649eb-10e5-4fc0-8221-50f0a2330ba5 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:58:09.555686 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=4 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:09.557174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:09.561646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:09.581209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:09.581767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:09.582212 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:09.641671 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Going to try to stop instance {{(pid=132240) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 12 10:58:09.687984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9f184b6b-f22f-4c27-bdc6-73e8307eeb88 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.141790 Aug 12 10:58:09.688644 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 491/945] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:58:09 2022] POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:58:09.698158 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:09.698965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:09.707159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:09.707896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:09.708456 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:09.709272 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:09.710035 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:09.710563 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:10.118392 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:10.126127 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dc60cb0c-d1b4-429e-829d-551d505441ba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.432786 Aug 12 10:58:10.126713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 455/946] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:09 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:11.156951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:11.158106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:11.168538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:11.169399 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:11.170073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:11.171239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:11.171989 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:11.172859 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:11.307918 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:11.318648 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-573a9b9b-219a-4541-8526-de7fb4f45851 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.170035 Aug 12 10:58:11.319208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 492/947] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:11 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:12.339243 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:12.339856 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:12.346519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:12.346998 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:12.347426 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:12.348117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:12.348583 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:12.349286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:12.498068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:12.509066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-12bdccaf-ba2e-4316-9fce-81c91bb3e09d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.173668 Aug 12 10:58:12.509732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 456/948] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:12 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:13.535536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:13.536620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:13.548007 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:13.548855 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:13.549569 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:13.550696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:13.551698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:13.557769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:13.707333 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:13.715518 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f91f999e-04d2-4d6b-81c6-d50b6aaf565f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.186846 Aug 12 10:58:13.716089 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 493/949] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:13 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:14.741604 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:14.742586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:14.752805 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:14.753662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:14.754400 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:14.755541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:14.756339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:14.757025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:14.893176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:14.901556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-de652723-dab9-4a1d-8280-192318bb6f47 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.166986 Aug 12 10:58:14.902089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 457/950] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:14 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:15.929114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:15.930122 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:15.940752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:15.941540 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:15.942254 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:15.943394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:15.944142 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:15.944880 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:16.094038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:16.102188 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-94483106-b825-4edf-ae01-92fdeca7e07e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.179628 Aug 12 10:58:16.102781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 494/951] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:15 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:17.127479 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:17.128481 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:17.140017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:17.140878 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:17.141612 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:17.142803 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:17.143525 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:17.144238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:17.280357 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:17.288634 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1f9ab7ed-a883-4fe2-9ea0-018de1191647 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.167736 Aug 12 10:58:17.289190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 458/952] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:17 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:18.310156 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:18.310769 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:18.317447 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:18.317937 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:18.318374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:18.319087 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:18.319547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:18.319970 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:18.455998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:18.464548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dff476d9-339b-4fe5-beca-946ec512c70d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.158434 Aug 12 10:58:18.465077 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 495/953] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:18 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:19.486104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:19.486724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:19.493619 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:19.494121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:19.494956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:19.495293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:19.495743 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:19.496170 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:19.650654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:19.658838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3a8e3820-0d62-4823-82dc-abcbb949fdba tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.176716 Aug 12 10:58:19.659415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 459/954] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:19 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:19.799980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-599511208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-864958502", "security_groups": [{"name": "tempest-secgroup-smoke-1080585724"}], "networks": [{"uuid": "204b522c-0341-41a7-8fe5-ec1ed9de00ea"}], "block_device_mapping_v2": [{"uuid": "555334d2-854a-4e1a-ab8c-fec3ce15074a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:19.915138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.network.neutron [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] validate_networks() for [('204b522c-0341-41a7-8fe5-ec1ed9de00ea', None, None, None, None, None)] {{(pid=132240) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:58:20.309568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Flavor limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:58:20.309996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Image limits 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:58:20.310479 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Flavor pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:58:20.310923 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Image pref 0:0:0 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:58:20.311331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.virt.hardware [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132240) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:58:20.321005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:20.321490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:20.321922 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:20.322780 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:20.323166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:20.323590 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:20.341019 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Getting quotas for project fafc312df1404fc6bbc28415bb744411. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:58:20.345641 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Getting quotas for user f16bdb81c5a249bb9f95e390dbd0dbfd and project fafc312df1404fc6bbc28415bb744411. Resources: {'instances', 'ram', 'cores'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:58:20.407787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Going to run 1 instances... {{(pid=132240) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:58:20.409910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='555334d2-854a-4e1a-ab8c-fec3ce15074a',volume_size=None,volume_type=None)] {{(pid=132240) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:58:20.545837 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-79664b3c-cae4-4c8d-8e62-a4af7145f726 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.749976 Aug 12 10:58:20.546489 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 496/955] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:58:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:58:20.558347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b4b717d9-4a0a-43aa-bf67-b1e49e8140b5 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:20.559047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b4b717d9-4a0a-43aa-bf67-b1e49e8140b5 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:20.632691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b4b717d9-4a0a-43aa-bf67-b1e49e8140b5 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:20.642686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b4b717d9-4a0a-43aa-bf67-b1e49e8140b5 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1087 microversion: 2.1 time: 0.088936 Aug 12 10:58:20.643547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 460/956] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:20 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:20.681138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:20.682508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:20.689180 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:20.689678 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:20.690112 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:20.690825 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:20.691860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:20.691860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:20.843912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:20.851745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-12b2396f-5845-4684-9118-2434700310ca tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.175645 Aug 12 10:58:20.852349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 497/957] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:20 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:21.669752 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:21.670820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:21.683040 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:21.683540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:21.683971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:21.684693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:21.685148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:21.685568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:21.755391 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:21.766731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e1eb4131-5a8f-4aa4-b033-f3dd5a45e6e8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1137 microversion: 2.1 time: 0.103420 Aug 12 10:58:21.767580 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 461/958] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:21 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1137 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:21.876559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:21.877318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:21.885865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:21.886357 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:21.886787 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:21.887470 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:21.887920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:21.888375 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:22.032198 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:22.040220 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-50cdf876-4d5b-43ae-9d82-b1d0e81966f0 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.168788 Aug 12 10:58:22.040956 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 498/959] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:21 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:22.788071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:22.788692 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:22.795739 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:22.796234 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:22.796705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:22.797375 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:22.797868 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:22.798300 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:22.860372 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:22.868701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1b93ea58-7281-494c-be57-9eda7c29da4d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1137 microversion: 2.1 time: 0.084532 Aug 12 10:58:22.869293 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 462/960] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:22 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1137 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:23.065827 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:23.067003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:23.078843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:23.079640 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:23.080460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:23.081565 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:23.082307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:23.082994 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:23.236186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:23.246185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-59faaa86-d32b-4316-963c-ced57ffa1082 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.186775 Aug 12 10:58:23.246776 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 499/961] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:23 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:23.890207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:23.890738 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:23.897568 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:23.898063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:23.898514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:23.899556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:23.900029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:23.900577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:23.963770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:23.971708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-36b20958-8a94-4f7c-a318-a949f1d9b580 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1129 microversion: 2.1 time: 0.085578 Aug 12 10:58:23.972311 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 463/962] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:23 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1129 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:24.271741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:24.272736 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:24.284215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:24.285138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:24.285904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:24.287052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:24.287810 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:24.288579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:24.431214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:24.439374 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-39df908b-f3a0-4649-b502-138ceb35144d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.174300 Aug 12 10:58:24.439959 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 500/963] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:24 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:24.993417 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:24.994032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:25.001552 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:25.002029 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:25.002699 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:25.003407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:25.003911 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:25.004782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:25.075196 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:25.082995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8183baa4-b93a-49e4-ad35-b22acb733d97 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1203 microversion: 2.1 time: 0.093472 Aug 12 10:58:25.083536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 464/964] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:24 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1203 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 10:58:25.461378 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:25.462055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:25.469893 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:25.470471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:25.470982 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:25.471781 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:25.472325 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:25.472819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:25.606862 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:25.614519 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e68a2687-79c8-4447-820b-71e85a4eec35 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.158240 Aug 12 10:58:25.615106 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 501/965] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:25 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:25.862042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:25.872739 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:25.873306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:25.873852 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:25.885099 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] Creating event network-changed:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 10:58:25.890339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-92f5ecf5-65f9-438b-a3d7-626f89a38d3b req-d45f0a91-65c4-4fc4-9e47-9781808bcdaf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032077 Aug 12 10:58:25.891091 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 465/966] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:58:26.108386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:26.108996 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:26.115382 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:26.115632 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:26.116253 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:26.117091 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:26.117431 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:26.118040 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:26.277918 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:26.288574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1cd120cb-6ab6-4323-b626-f2dc2ab98725 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.183533 Aug 12 10:58:26.289829 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 502/967] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:26 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:26.636661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:26.637777 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:26.647744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:26.648230 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:26.648700 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:26.649722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:26.650175 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:26.650623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:26.814857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:26.827076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c01ef0bd-fb88-45d2-b386-5246c780c974 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.195060 Aug 12 10:58:26.827854 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 466/968] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:26 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:27.313572 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:27.314464 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:27.323809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:27.324313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:27.324744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:27.325458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:27.325910 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:27.326329 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:27.466792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:27.474437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9f4c6474-e7d6-4f4e-8a74-db891dd0ef46 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.166685 Aug 12 10:58:27.474995 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 503/969] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:27 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:27.854894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:27.856286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:27.867259 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:27.868069 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:27.868858 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:27.870291 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:27.871207 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:27.871637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:28.016044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:28.023872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-450405cc-8afb-4602-a72f-46124c5c3065 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.176065 Aug 12 10:58:28.024837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 467/970] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:27 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:28.497096 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:28.497699 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:28.504551 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:28.505029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:28.505458 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:28.506141 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:28.506584 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:28.506999 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:28.643015 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:28.651372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-09920a5b-01f3-452e-bb69-f22e96dd3e7e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.159986 Aug 12 10:58:28.651981 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 504/971] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:28 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:29.050833 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:29.051926 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:29.055802 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=31 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.063076 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:29.063566 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:29.064002 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:29.064732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:29.065190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:29.065622 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:29.068384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:29.211156 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:29.219117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-63e1eba6-c6d7-4a83-be1c-efb5b66db07a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1677 microversion: 2.1 time: 0.174887 Aug 12 10:58:29.219724 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 468/972] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:29 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:29.675573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:29.677683 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:29.695328 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:29.697260 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:29.698181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:29.699474 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:29.700002 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:29.700523 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:29.854251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:29.863309 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2abb4b7d-be8d-4c77-a0bb-76d94bde1068 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.195685 Aug 12 10:58:29.864848 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 505/973] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:29 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.242792 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:30.243509 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:30.252691 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.253387 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.253971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.254894 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.255508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.256079 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.396675 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:30.410532 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-78fc0e18-d9c0-47a7-9ecb-286c20216ede tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1654 microversion: 2.1 time: 0.172832 Aug 12 10:58:30.411423 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 469/974] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:30 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1654 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.435280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:30.437642 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.438349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=6 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.444352 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.444840 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.445276 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.468346 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Going to try to start instance {{(pid=132240) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 12 10:58:30.484720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.514350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-669aaca7-5fdf-4034-844a-0154b0c3a3de tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action" status: 202 len: 0 microversion: 2.1 time: 0.082952 Aug 12 10:58:30.514975 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 506/975] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 10:58:30 2022] POST /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 10:58:30.523345 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:30.525000 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:30.531721 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.532450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.533131 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.540704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.541270 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.541728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.638772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:30.687688 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:30.697620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-201b5a74-2c8c-4c39-a6e3-945a79e4569b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1663 microversion: 2.1 time: 0.178298 Aug 12 10:58:30.705331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 470/976] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:30 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1663 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:30.885733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:30.886490 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:30.893509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.894187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.894428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:30.895132 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:30.895580 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:30.896000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:31.033001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:31.040903 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-72358af4-f062-4899-a75c-431f724197a8 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.159967 Aug 12 10:58:31.041476 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 507/977] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:30 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:31.719996 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:31.720762 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:31.728038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:31.728565 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:31.729005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:31.729723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:31.730986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:31.731899 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:31.870718 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:31.879193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-731e5753-c647-4af1-8968-d59310c7dd0d tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1663 microversion: 2.1 time: 0.164120 Aug 12 10:58:31.879772 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 471/978] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:31 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:32.063350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:32.063969 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:32.070965 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:32.071459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:32.071938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:32.072628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:32.073064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:32.073675 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:32.214432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:32.222904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-970a566c-bfc1-420c-b07d-c74c0ea4492d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.163871 Aug 12 10:58:32.223607 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 508/979] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:32 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:32.901404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:32.902090 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:32.909264 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:32.909754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:32.910189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:32.910892 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:32.911350 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:32.911774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:33.060089 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:33.068125 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-821c778b-d378-4780-af51-d2ebc88f10c5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1667 microversion: 2.1 time: 0.171031 Aug 12 10:58:33.068751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 472/980] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:32 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1667 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:33.245237 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:33.245866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:33.253704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:33.254238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:33.254812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:33.255608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:33.256120 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:33.256630 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:33.409526 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:33.417191 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dec68ed5-8f83-454a-8d83-c19b0939555d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.176183 Aug 12 10:58:33.417765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 509/981] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:33 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:34.439086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:34.439607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:34.445902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:34.446395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:34.446863 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:34.447556 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:34.448003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:34.448456 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:34.586966 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:34.594648 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-57097029-31e4-49a2-abac-a35b12689f8e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.159712 Aug 12 10:58:34.595223 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 473/982] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:34 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:35.615521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:35.618155 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:35.627460 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:35.627951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:35.628424 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:35.629124 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:35.629614 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:35.630041 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:35.820313 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:35.828386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a731a016-6b0e-4d17-bb0d-ef9faf202f45 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.216737 Aug 12 10:58:35.841389 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 510/983] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:35 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:36.497808 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "name": "network-vif-plugged", "status": "completed", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:36.509888 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:36.510385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:36.510820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:36.525561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] Creating event network-vif-plugged:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 10:58:36.530806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-cc5a3ed1-b9b4-4896-8bd5-690d002dede8 req-a6ffb85e-e3d5-46a4-801b-43035f0313c5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037651 Aug 12 10:58:36.531559 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 474/984] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:58:36.850852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:36.852560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:36.861390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:36.862195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:36.862873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:36.863988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:36.864845 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:36.865337 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:37.004716 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:37.013192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b97faee4-f8d6-4773-9b06-65022a4f1dca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.167232 Aug 12 10:58:37.013760 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 511/985] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:36 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:38.040625 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:38.041650 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:38.052169 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:38.053017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:38.053744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:38.054934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:38.055693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:38.056472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:38.196667 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:38.204940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e741051e-62fe-4189-b5b8-63e69bf6cd04 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1259 microversion: 2.1 time: 0.172560 Aug 12 10:58:38.205516 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 475/986] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:38 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:39.227538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:39.228231 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:39.237255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:39.237765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:39.238201 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:39.238915 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:39.239394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:39.239809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:39.382475 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:39.391764 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5e4dc79d-2492-40c4-bb05-f0921cdc8541 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1442 microversion: 2.1 time: 0.169927 Aug 12 10:58:39.392351 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 512/987] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:39 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1442 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:39.413730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:58:39.414351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:58:39.421313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:39.421809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:39.422250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:39.422956 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:39.423420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:39.423844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:39.565038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:58:39.573058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2e292b3c-03ab-4910-ba71-9ef68a9a6a4c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1442 microversion: 2.1 time: 0.163224 Aug 12 10:58:39.573591 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 476/988] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:58:39 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1442 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:58:41.428449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:58:41.434445 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:58:41.440538 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:58:41.441093 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:58:41.441597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:58:41.454354 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] Creating event network-changed:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 10:58:41.460186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-ce47a527-b080-472c-9f8e-1c83651aa441 req-5ae935d9-fb38-492a-9968-b883ddedc0b1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035344 Aug 12 10:58:41.460872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 513/989] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:11.440713 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:11.442887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:11.445204 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=17 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.445859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=49 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.451554 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.452045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.452581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.453741 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.454192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.454618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.483606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d8141f49-ea5a-4178-98ec-bd0d3a0f48fc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047284 Aug 12 10:59:11.484242 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 477/990] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 10:59:11 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 10:59:11.547206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=40,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.547941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:11.551931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:11.552611 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:11.559931 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.560442 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.560872 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.561574 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.562019 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.562456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.749391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 10:59:11.832548 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-523185f6-aeac-472b-b08e-2f4b7f72fb31 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 204 len: 0 microversion: 2.1 time: 0.286841 Aug 12 10:59:11.833153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 514/991] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 10:59:11 2022] DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 10:59:11.842317 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:11.843286 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:11.849657 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.850450 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.850960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.851720 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:11.852168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:11.852611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:11.986435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:11.998658 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8bd84368-14fb-45d9-bd69-27961d4594e3 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1673 microversion: 2.1 time: 0.160429 Aug 12 10:59:11.999533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 478/992] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:11 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:13.026044 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:13.027179 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:13.038146 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:13.038943 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:13.039660 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:13.040852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:13.041621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:13.042326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:13.182796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:13.190973 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bbf8108d-060e-4dc9-a3b4-84e87d752372 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1673 microversion: 2.1 time: 0.172583 Aug 12 10:59:13.191527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 515/993] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:13 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:14.212828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:14.214096 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:14.220460 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:14.220950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:14.221379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:14.222075 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:14.222520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:14.222963 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:14.356704 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:14.365406 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-157e199f-80e1-47bd-96f2-a4d5d45abb65 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1673 microversion: 2.1 time: 0.156702 Aug 12 10:59:14.366009 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 479/994] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:14 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:14.807900 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d", "name": "network-vif-deleted", "tag": "0e990323-9e61-4df5-bcd8-ed0475552190"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:14.818293 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:14.818778 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:14.819262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:14.831730 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] Creating event network-vif-deleted:0e990323-9e61-4df5-bcd8-ed0475552190 for instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d on hv-cinder-85294 Aug 12 10:59:14.836943 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-27e23ae1-e2aa-4925-a9e1-e3dbbf86305d req-bf6c0854-8dfe-4d9b-9bcd-a1093b23c419 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033098 Aug 12 10:59:14.837791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 516/995] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:15.387644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:15.388384 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:15.394902 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:15.395395 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:15.395837 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:15.396572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:15.397032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:15.397461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:15.428833 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:15.429312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:15.429759 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:15.430191 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lazy-loading 'fault' on Instance uuid 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 10:59:15.473672 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:15.482001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-26c21555-918e-43f4-8e58-1372669276dc tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 200 len: 1327 microversion: 2.1 time: 0.098828 Aug 12 10:59:15.482763 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 480/996] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:15 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:16.509189 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:16.510340 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:16.519830 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:16.520311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:16.520774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:16.521493 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:16.521964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:16.522385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:16.536555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d HTTP/1.1 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 10:59:16.538214 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 10:59:16.539867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d'} Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 10:59:16.541138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 10:59:16.542733 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 10:59:16.544320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 10:59:16.544320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b29b41c7-cc04-473a-a8a0-8c93c75cc031 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 404 len: 111 microversion: 2.1 time: 0.038375 Aug 12 10:59:16.544320 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 517/997] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:16 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 10:59:16.548872 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9a961d60-6c07-4a35-90ca-9aeec22d39bd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '.version_select at 0x7efc5c9d4b80>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:16.571428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9a961d60-6c07-4a35-90ca-9aeec22d39bd tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057270753" status: 202 len: 0 microversion: 2.1 time: 0.026677 Aug 12 10:59:16.571993 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 481/998] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Aug 12 10:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1057270753 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 12 10:59:17.463053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-111a5074-21bd-409e-bc3d-1ec01451b575 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: .version_select at 0x7efc611acca0>, body: {"keypair": {"name": "tempest-keypair-1677748804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI6o2a93FwxcShexJ2lp/bIGt5WxjFqN2xpd+NDK94fQf47SEX2EybKk4K1qRttBjETulPDqKS/3xsbptN8OvC2+eM6JPwBKCc9No3mmsAq33pBOkyQZyr2I8BpI26BaQ=="}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:17.478262 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-111a5074-21bd-409e-bc3d-1ec01451b575 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for project b93ff276e6894c77a231ef075b02ca9a. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:59:17.482075 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.quota [None req-111a5074-21bd-409e-bc3d-1ec01451b575 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for user 5cde581444394ae0b342d0c1ec435c76 and project b93ff276e6894c77a231ef075b02ca9a. Resources: {'key_pairs'} {{(pid=132240) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:59:17.507008 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-111a5074-21bd-409e-bc3d-1ec01451b575 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047964 Aug 12 10:59:17.507589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 518/999] 10.222.0.23 () {60 vars in 1159 bytes} [Fri Aug 12 10:59:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:18.893433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-903044284", "imageRef": "f6a83e72-52c8-450a-ac99-db6edfe25eef", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30c65d8e-0ee5-4530-82d1-53538bb488b6"}], "security_groups": [{"name": "tempest-securitygroup--36805654"}], "key_name": "tempest-keypair-1677748804", "user_data": "}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:19.003443 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] validate_networks() for [('30c65d8e-0ee5-4530-82d1-53538bb488b6', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:59:19.405306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:59:19.405735 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:59:19.406210 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:59:19.406623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:59:19.407033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:59:19.416931 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:19.417415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:19.417880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:19.418610 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:19.419066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:19.419490 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:19.437256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for project b93ff276e6894c77a231ef075b02ca9a. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:59:19.442066 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Getting quotas for user 5cde581444394ae0b342d0c1ec435c76 and project b93ff276e6894c77a231ef075b02ca9a. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:59:19.454307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:59:19.456778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f6a83e72-52c8-450a-ac99-db6edfe25eef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:59:19.506770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5f3e74b7-e9e6-4ed8-a071-7f549ddb50cb tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.618492 Aug 12 10:59:19.507421 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 482/1000] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:59:18 2022] POST /compute/v2.1/servers => generated 400 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:59:19.524062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f825b017-8329-499e-b2fe-8c35478fc2f1 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:19.525316 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f825b017-8329-499e-b2fe-8c35478fc2f1 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:19.589137 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-f825b017-8329-499e-b2fe-8c35478fc2f1 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:19.596823 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f825b017-8329-499e-b2fe-8c35478fc2f1 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1237 microversion: 2.1 time: 0.079192 Aug 12 10:59:19.597372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 519/1001] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:19 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1237 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:20.620948 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:20.621801 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:20.630893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:20.631391 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:20.631828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:20.632847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:20.633491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:20.634137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:20.701751 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:20.710351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-845c0470-0611-4c1b-98c9-79cf1ce45304 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1297 microversion: 2.1 time: 0.096252 Aug 12 10:59:20.711148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 483/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:20 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:21.731331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:21.732058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:21.739228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:21.739743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:21.740168 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:21.740905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:21.741359 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:21.741785 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:21.879701 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:21.893310 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dd0abe6d-cff2-4968-9619-93f4b1faebaf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.165901 Aug 12 10:59:21.894349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 520/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:21 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:22.046678 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c4b17d-b0f9-4d24-918e-d1473b531072", "tag": "29666a3f-291f-4920-81b5-2a3441f32c62"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:22.059244 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:22.059731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:22.060168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:22.072305 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] Creating event network-changed:29666a3f-291f-4920-81b5-2a3441f32c62 for instance 65c4b17d-b0f9-4d24-918e-d1473b531072 on hv-cinder-85294 Aug 12 10:59:22.077310 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-f2429dca-1496-403d-b486-e1f241e24b0d req-e20c2805-fe01-4290-975a-93d739248ccb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034461 Aug 12 10:59:22.078045 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 484/1004] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:22.919268 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:22.920411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:22.931056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:22.931844 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:22.932629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:22.933767 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:22.934511 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:22.935209 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:23.076114 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:23.084397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-961df925-1dc3-454a-955a-6cd738655fc8 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.171687 Aug 12 10:59:23.084959 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 521/1005] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:22 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:24.111215 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:24.112364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:24.119511 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:24.120003 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:24.120473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:24.121162 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:24.121616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:24.122049 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:24.260723 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:24.268508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-baa3f240-3a52-49e4-8d1b-c227f8995a9e tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.165017 Aug 12 10:59:24.269321 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 485/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:24 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:25.290058 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:25.290664 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:25.297627 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:25.298107 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:25.298543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:25.299243 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:25.299698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:25.300134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:25.441115 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:25.449043 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-e80dee46-56c6-498d-a65f-2a0bdbbbe7e5 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.162911 Aug 12 10:59:25.449595 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 522/1007] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:25 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:26.472290 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:26.472899 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:26.479641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:26.480027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:26.480499 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:26.481192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:26.481649 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:26.482073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:26.615628 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:26.624253 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-2184e474-cf8f-4e3a-be4e-adc3c0e94347 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.155877 Aug 12 10:59:26.625491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 486/1008] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:26 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:26.747765 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c4b17d-b0f9-4d24-918e-d1473b531072", "name": "network-vif-plugged", "status": "completed", "tag": "29666a3f-291f-4920-81b5-2a3441f32c62"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:26.763437 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:26.763925 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:26.764370 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:26.778110 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] Creating event network-vif-plugged:29666a3f-291f-4920-81b5-2a3441f32c62 for instance 65c4b17d-b0f9-4d24-918e-d1473b531072 on hv-cinder-85294 Aug 12 10:59:26.783882 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-0d0b10e9-d5dd-41b5-b63c-32e751a135b0 req-e4ae6a95-19c1-4e84-acdc-2d7759c41f39 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047059 Aug 12 10:59:26.785849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 523/1009] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:27.646955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:27.647548 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:27.655618 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:27.656284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:27.657002 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:27.657696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:27.658418 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:27.658855 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:27.833273 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:27.841572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dad74723-626d-4641-8d25-445e097aed1f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.199833 Aug 12 10:59:27.842153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 487/1010] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:27 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:28.866557 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:28.867164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:28.876153 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:28.876860 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:28.877394 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:28.878195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:28.878741 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:28.879261 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:29.022345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:29.035131 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bbd5de82-b2ef-4f93-84d2-73b62fc0e197 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.175533 Aug 12 10:59:29.036014 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 524/1011] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:28 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:30.060859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:30.062136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:30.064664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.065408 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:30.071257 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:30.071753 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:30.072190 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:30.072941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:30.073971 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:30.074386 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:30.218379 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:30.226922 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-da7709a9-c17d-4b30-83c4-e3f4cab938c9 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1361 microversion: 2.1 time: 0.171543 Aug 12 10:59:30.227500 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 488/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:30 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:31.250208 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:31.250833 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:31.252832 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=6 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:31.258749 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:31.259224 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:31.259658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:31.260353 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:31.260808 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:31.261255 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:31.396665 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:31.405656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-2ff125f3-3b6e-4872-b54d-14b324692027 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1547 microversion: 2.1 time: 0.159389 Aug 12 10:59:31.406307 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 525/1013] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:31 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:31.425779 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:31.426308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:31.433489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:31.433974 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:31.434405 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:31.435097 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:31.435546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:31.435969 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:31.523302 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1773fcd1-e6dc-4984-87b2-91d05dedb145 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101011 Aug 12 10:59:31.524063 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 489/1014] 10.222.0.23 () {58 vars in 1275 bytes} [Fri Aug 12 10:59:31 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:32.486393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65c4b17d-b0f9-4d24-918e-d1473b531072", "tag": "29666a3f-291f-4920-81b5-2a3441f32c62"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:32.496689 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:32.497164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:32.497602 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:32.508744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] Creating event network-changed:29666a3f-291f-4920-81b5-2a3441f32c62 for instance 65c4b17d-b0f9-4d24-918e-d1473b531072 on hv-cinder-85294 Aug 12 10:59:32.513946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-aa94b311-8205-4f35-8a29-9a6d8de0216d req-38bd22d8-3583-4ef4-bf5d-b4dc57cf7dc9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031426 Aug 12 10:59:32.514719 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 526/1015] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:33.539137 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1699992114", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-902672255", "security_groups": [{"name": "tempest-secgroup-smoke-1804087682"}], "block_device_mapping_v2": [{"uuid": "fb285998-e9d7-44a1-936c-e1e72b9c533e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5449083c-84b0-405b-91f7-10223968ec01"}]}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:33.649830 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.network.neutron [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] validate_networks() for [('5449083c-84b0-405b-91f7-10223968ec01', None, None, None, None, None)] {{(pid=132239) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 12 10:59:34.033267 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 12 10:59:34.033908 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image limits 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 12 10:59:34.034555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Flavor pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 12 10:59:34.035148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Image pref 0:0:0 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 12 10:59:34.035732 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.virt.hardware [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 12 10:59:34.047010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:34.047453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:34.047899 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:34.048681 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:34.049143 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:34.049574 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:34.066279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 12 10:59:34.070348 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.quota [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Getting quotas for user 922f49fa7d324ebdade043e1be1a476f and project 89943304402242278f5614ea5bde6092. Resources: {'instances', 'ram', 'cores'} {{(pid=132239) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 12 10:59:34.139968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Going to run 1 instances... {{(pid=132239) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 12 10:59:34.142117 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb285998-e9d7-44a1-936c-e1e72b9c533e',volume_size=None,volume_type=None)] {{(pid=132239) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 12 10:59:34.277572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-9b75118a-aaba-48ea-9e4c-fc2ed7d9daf6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742854 Aug 12 10:59:34.278224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 490/1016] 10.222.0.23 () {60 vars in 1147 bytes} [Fri Aug 12 10:59:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 12 10:59:34.290098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-7e4694c5-6813-4aeb-8278-1a1b416790de tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:34.290798 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-7e4694c5-6813-4aeb-8278-1a1b416790de tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:34.352166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-7e4694c5-6813-4aeb-8278-1a1b416790de tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:34.359896 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-7e4694c5-6813-4aeb-8278-1a1b416790de tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1094 microversion: 2.1 time: 0.074202 Aug 12 10:59:34.360514 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 527/1017] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:34 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:35.382270 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:35.382966 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:35.391318 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:35.391806 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:35.392466 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:35.393176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:35.393780 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:35.394221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:35.462789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:35.470749 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-26fe3a17-e98a-48d6-ad02-aa8a69548c59 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1210 microversion: 2.1 time: 0.093408 Aug 12 10:59:35.471334 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 491/1018] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:35 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:36.491936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:36.492597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:36.500520 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:36.501000 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:36.501456 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:36.502175 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:36.502631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:36.503164 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:36.642294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:36.649792 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-79e3ac95-76f8-42bd-b7aa-93d7b63dacd5 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.161988 Aug 12 10:59:36.650690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 528/1019] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:36 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:36.733006 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712a769-28fc-4968-9bbe-56427684e1da", "tag": "639b171d-4ebe-4c62-9438-749ba0ac6881"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:36.744941 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:36.745416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:36.745923 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:36.758360 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] Creating event network-changed:639b171d-4ebe-4c62-9438-749ba0ac6881 for instance a712a769-28fc-4968-9bbe-56427684e1da on hv-cinder-85294 Aug 12 10:59:36.763953 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-28f2acd7-a416-4717-b752-35cb15065c90 req-302fd317-5a7c-4dd8-85a9-d5d61e0c7241 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035011 Aug 12 10:59:36.764722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 492/1020] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:37.673835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:37.674453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:37.681251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:37.681753 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:37.682181 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:37.682869 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:37.683305 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:37.684085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:37.830647 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:37.838233 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-28b4b17e-4837-4ed3-a80d-05774158eed2 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.169029 Aug 12 10:59:37.838791 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 529/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:37 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:38.860461 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:38.861161 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:38.867950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:38.868402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:38.868838 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:38.869540 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:38.870004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:38.870428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:39.280750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:39.292071 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c222b95a-c814-4ed8-8ff6-e74f53a40ee4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.436209 Aug 12 10:59:39.292942 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 493/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:38 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:40.319600 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:40.320696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:40.331985 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:40.332835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:40.333582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:40.334698 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:40.335471 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:40.336247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:40.486953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:40.497847 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-dc361557-b381-45fb-835e-139788c9748b tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.184828 Aug 12 10:59:40.498407 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 530/1023] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:40 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:41.522664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:41.523679 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:41.528105 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.537424 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:41.538087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:41.538875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:41.540238 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:41.541033 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:41.541731 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:41.546179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=81 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:41.684316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:41.695886 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f4741c53-c0ff-4ad4-b106-8af026d38644 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.179401 Aug 12 10:59:41.696729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 494/1024] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:41 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:42.717659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:42.718285 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:42.720774 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.726053 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:42.726543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:42.726966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:42.727639 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:42.728081 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:42.728537 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:42.731879 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:42.866916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:42.879306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-84111526-d7bb-4117-b7a3-40a8f49e9ee7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.165548 Aug 12 10:59:42.880067 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 531/1025] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:42 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:43.905988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:43.906828 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:43.916371 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:43.917122 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:43.917750 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:43.918722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:43.919607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:43.919866 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:44.055875 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:44.062848 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:44.070523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-af796489-3552-4cfe-917f-ce31f803f8b9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.170830 Aug 12 10:59:44.071129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 495/1026] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:43 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:45.092134 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:45.092744 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:45.094609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell0:SELECT=2 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:45.100432 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:45.100917 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:45.101344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:45.102029 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:45.102472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:45.102891 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:45.233031 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:45.241732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-b8f29aba-96dd-4843-9bf8-0f8581e18464 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.153903 Aug 12 10:59:45.242412 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 532/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:45 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:46.266594 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:46.267581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:46.270316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell0:SELECT=6 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 10:59:46.279472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:46.279959 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:46.280420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:46.281120 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:46.281625 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:46.282049 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:46.414644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:46.422470 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-108c6d4d-901c-4493-b297-3b4dfe248a4d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.162062 Aug 12 10:59:46.423080 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 496/1028] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:46 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:46.852677 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712a769-28fc-4968-9bbe-56427684e1da", "name": "network-vif-plugged", "status": "completed", "tag": "639b171d-4ebe-4c62-9438-749ba0ac6881"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:46.864117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:46.864629 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:46.865991 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:46.877927 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] Creating event network-vif-plugged:639b171d-4ebe-4c62-9438-749ba0ac6881 for instance a712a769-28fc-4968-9bbe-56427684e1da on hv-cinder-85294 Aug 12 10:59:46.883125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-140ad24d-1927-4e54-a8db-8f1144c9a8c4 req-89a9380e-c9cc-4b1b-89b0-89882546d699 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Aug 12 10:59:46.883946 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 533/1029] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 10:59:47.451193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:47.451864 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:47.459764 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:47.460341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:47.460877 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:47.461683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:47.462212 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:47.462709 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:47.621001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:47.631928 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-1e395a84-35a8-40cc-bad6-744023585078 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1266 microversion: 2.1 time: 0.187116 Aug 12 10:59:47.632698 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 497/1030] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:47 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:48.658074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:48.658822 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:48.665621 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:48.666117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:48.666543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:48.667330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:48.667809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:48.668195 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:48.816964 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:48.824782 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9d01b832-03bd-407e-abcc-982a83092e8f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1453 microversion: 2.1 time: 0.171529 Aug 12 10:59:48.825589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 534/1031] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:48 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:48.848881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 10:59:48.849458 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 10:59:48.856202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:48.856924 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:48.857343 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:48.858044 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:48.858500 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:48.858929 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:49.011680 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 10:59:49.019642 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6e47f7e2-21ba-4602-98da-ae165ad8b087 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1453 microversion: 2.1 time: 0.177883 Aug 12 10:59:49.020219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 498/1032] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 10:59:48 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1453 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 10:59:50.663372 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712a769-28fc-4968-9bbe-56427684e1da", "tag": "639b171d-4ebe-4c62-9438-749ba0ac6881"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 10:59:50.673221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 10:59:50.673696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 10:59:50.674123 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 10:59:50.685905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] Creating event network-changed:639b171d-4ebe-4c62-9438-749ba0ac6881 for instance a712a769-28fc-4968-9bbe-56427684e1da on hv-cinder-85294 Aug 12 10:59:50.690988 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-b095ac6a-f3c3-4700-b800-561ee711e09f req-e63972b7-c43d-48cb-b984-c1fb4d378d0c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031330 Aug 12 10:59:50.691711 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 535/1033] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 10:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:08.435541 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:08.436555 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:08.440247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=9 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.441553 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=29 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:08.451606 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:08.452448 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:08.453221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:08.454364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:08.455103 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:08.455791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:08.481567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-11e6eb4d-4429-4339-a569-fe7f80f2a892 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/ips" status: 200 len: 146 microversion: 2.1 time: 0.052413 Aug 12 11:00:08.482361 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 499/1034] 10.222.0.23 () {58 vars in 1248 bytes} [Fri Aug 12 11:00:08 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:09.853854 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=9 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.854598 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=21 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:09.859185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c6ee834-7903-498d-a329-080bc268cd09"}} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:09.861636 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:09.868940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:09.869414 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:09.869843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:09.870525 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:09.870963 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:09.871376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:10.169200 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c2c57a87-cadc-4796-86e0-75eb5deb3980 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316657 Aug 12 11:00:10.169818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 536/1035] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 11:00:09 2022] POST /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:17.739906 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:17.742744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:17.749279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:17.749765 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:17.750206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:17.750899 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:17.751353 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:17.751775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:17.782313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e58efc69-a9f3-4512-8f77-efc3392cf132 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Aug 12 11:00:17.782880 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 500/1036] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 11:00:17 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:17.794349 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:17.794898 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:17.801762 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:17.802245 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:17.802675 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:17.803371 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:17.803851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:17.804295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:17.832732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ecb6044e-7580-4f50-a23e-39560cdc10ab tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09" status: 200 len: 194 microversion: 2.1 time: 0.042771 Aug 12 11:00:17.833306 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 537/1037] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Aug 12 11:00:17 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:19.194457 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3320662e-63cb-4693-9bdc-f768b441fc59"}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:19.196914 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:19.204005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:19.204545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:19.205021 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:19.205694 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:19.206153 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:19.206608 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:19.649381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7214534e-90cb-41f4-b12e-61dda5b95e64 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "POST /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458791 Aug 12 11:00:19.650068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 501/1038] 10.222.0.23 () {60 vars in 1323 bytes} [Fri Aug 12 11:00:19 2022] POST /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 194 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:27.250291 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:27.253466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:27.260113 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.260663 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.261206 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.262072 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.262589 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.263013 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.295936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-24fa3026-4f32-4f55-874b-383e607e7424 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049624 Aug 12 11:00:27.296550 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 538/1039] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 11:00:27 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:27.470445 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:27.471110 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:27.479560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.480168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.480774 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.481646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.482218 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.482755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.513960 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-faeca8b0-16db-4117-ba85-6c7a9e978c8b tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09" status: 200 len: 194 microversion: 2.1 time: 0.049627 Aug 12 11:00:27.514549 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 502/1040] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Aug 12 11:00:27 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:27.531902 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:27.532609 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:27.541332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.541815 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.542247 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.542934 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:27.543380 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:27.543836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:27.684457 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lazy-loading 'services' on Instance uuid 65c4b17d-b0f9-4d24-918e-d1473b531072 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:00:27.760967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-f9c545b1-9e53-4011-9aaf-d830636e1ed7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09" status: 202 len: 0 microversion: 2.1 time: 0.235971 Aug 12 11:00:27.761539 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 539/1041] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 11:00:27 2022] DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/2c6ee834-7903-498d-a329-080bc268cd09 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:00:28.168064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:00:28.168656 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Fri Aug 12 11:00:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:00:29.959420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:29.959999 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:29.968192 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:29.968981 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:29.969631 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:29.970666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:29.971351 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:29.971976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:30.003306 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-feae6318-88db-41b5-80a2-48d1e0ee744a tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/3320662e-63cb-4693-9bdc-f768b441fc59" status: 200 len: 194 microversion: 2.1 time: 0.047863 Aug 12 11:00:30.003896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 503/1042] 10.222.0.23 () {58 vars in 1413 bytes} [Fri Aug 12 11:00:29 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/3320662e-63cb-4693-9bdc-f768b441fc59 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:30.021395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:30.022104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:30.031318 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:30.031796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:30.032221 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:30.033064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:30.033515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:30.033957 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:30.123104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lazy-loading 'services' on Instance uuid 65c4b17d-b0f9-4d24-918e-d1473b531072 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:00:30.202818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c26d7bd7-0eb3-4b51-8e78-6b1b64f54b37 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/3320662e-63cb-4693-9bdc-f768b441fc59" status: 202 len: 0 microversion: 2.1 time: 0.189129 Aug 12 11:00:30.203397 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 540/1043] 10.222.0.23 () {58 vars in 1416 bytes} [Fri Aug 12 11:00:30 2022] DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments/3320662e-63cb-4693-9bdc-f768b441fc59 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:00:32.450523 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:32.452799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:32.459587 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.460104 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.460560 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.461258 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.461708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.462129 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.491010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a33bf154-e87c-4b2a-b841-23de14124936 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044517 Aug 12 11:00:32.491558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 504/1044] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 11:00:32 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:00:32.608867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:32.611117 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:32.617324 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.617802 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.618232 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.618947 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.619384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.619801 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.651736 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3e625f54-6fab-4c49-b1a4-0fae4feb1062 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047598 Aug 12 11:00:32.652336 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 541/1045] 10.222.0.23 () {58 vars in 1302 bytes} [Fri Aug 12 11:00:32 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 12 11:00:32.714913 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:32.716139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:32.722489 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.723016 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.723402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.724159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.724769 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.725206 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.761085 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:00:32.852284 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-ea085a5e-6376-47cf-8f46-c5770b59f747 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 204 len: 0 microversion: 2.1 time: 0.141839 Aug 12 11:00:32.853433 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 505/1046] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:00:32 2022] DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:00:32.862433 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:32.863062 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:32.869143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.869646 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.870073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:32.870754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:32.871194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:32.871586 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:33.009071 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:33.017368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-105e0e3f-c2d2-4764-b852-4a40ba91f658 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1672 microversion: 2.1 time: 0.158909 Aug 12 11:00:33.017941 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 542/1047] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:32 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:34.045307 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:34.046470 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:34.057254 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:34.058078 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:34.058809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:34.059787 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:34.060359 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:34.060781 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:34.209809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:34.217825 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-79de8643-c38d-4c8b-b35a-94d6dea1ebdf tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1672 microversion: 2.1 time: 0.180873 Aug 12 11:00:34.218402 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 506/1048] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:34 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:35.239723 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:35.240737 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:35.248481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:35.248481 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:35.248824 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:35.249527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:35.249968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:35.250385 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:35.390355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:35.397953 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-9744e1d7-954d-4ea0-955b-2de951f267b7 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1672 microversion: 2.1 time: 0.162650 Aug 12 11:00:35.398494 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 543/1049] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:35 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:36.038413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65c4b17d-b0f9-4d24-918e-d1473b531072", "name": "network-vif-deleted", "tag": "29666a3f-291f-4920-81b5-2a3441f32c62"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:36.052174 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:36.052985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:36.053613 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:36.070184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] Creating event network-vif-deleted:29666a3f-291f-4920-81b5-2a3441f32c62 for instance 65c4b17d-b0f9-4d24-918e-d1473b531072 on hv-cinder-85294 Aug 12 11:00:36.078042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-f069d103-6576-4733-95bc-d9031c8168e2 req-158f0b83-0bd2-473e-ab39-b3ac91ad31d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044532 Aug 12 11:00:36.083202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 507/1050] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:00:36.419870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:36.420496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:36.427215 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:36.427728 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:36.428138 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:36.428877 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:36.429326 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:36.429750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:36.462203 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:36.462690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:36.463122 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:36.463573 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lazy-loading 'fault' on Instance uuid 65c4b17d-b0f9-4d24-918e-d1473b531072 {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:00:36.506319 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cde581444394ae0b342d0c1ec435c76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b93ff276e6894c77a231ef075b02ca9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:36.514857 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3d98bd20-8cf7-4b6e-83c8-87072d225744 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 200 len: 1327 microversion: 2.1 time: 0.099385 Aug 12 11:00:36.515393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 544/1051] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:36 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 1327 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:37.541796 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:37.542950 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:37.551428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:37.551912 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:37.552381 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:37.553081 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:37.553537 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:37.553965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:37.567869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 HTTP/1.1 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 11:00:37.569483 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:37.571001 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '65c4b17d-b0f9-4d24-918e-d1473b531072'} Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:00:37.571840 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:37.573401 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:37.574916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:00:37.574916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-566d94b1-3c08-48fe-baf7-9eb8e1be8c07 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 404 len: 111 microversion: 2.1 time: 0.036190 Aug 12 11:00:37.574916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 508/1052] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:37 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:00:37.582718 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-88ef32cb-68a8-4ffb-962d-a4a80727d093 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '.version_select at 0x7efc6122f700>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:37.607788 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-88ef32cb-68a8-4ffb-962d-a4a80727d093 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677748804" status: 202 len: 0 microversion: 2.1 time: 0.031256 Aug 12 11:00:37.608343 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 545/1053] 10.222.0.23 () {58 vars in 1221 bytes} [Fri Aug 12 11:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1677748804 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:00:38.767903 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:38.768520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:38.770927 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.777058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:38.777545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:38.777982 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:38.778682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:38.779155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:38.779988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:38.784720 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:38.808530 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lazy-loading 'flavor' on Instance uuid aab4a75f-189f-46c5-ae08-079237c8ca90 {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:00:38.892623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0dd9d83f-bd22-442f-9d15-cf149970fa90 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "POST /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90/action" status: 202 len: 0 microversion: 2.1 time: 0.130677 Aug 12 11:00:38.893088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 509/1054] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 11:00:38 2022] POST /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:00:38.902729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:38.903420 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:38.911835 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:38.912667 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:38.914144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:38.914928 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:38.915651 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:38.916148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:39.059936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:39.067905 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-c030ecf6-f857-4bdf-8679-9c5ff76f8a81 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.170080 Aug 12 11:00:39.068582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 546/1055] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:38 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:40.090793 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:40.091477 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:40.111349 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.111844 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.112294 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.113027 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.113486 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.113943 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.259782 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:40.268278 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7fed2af2-ab24-4540-a6c3-357dad0ef1ca tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.182458 Aug 12 11:00:40.268857 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 510/1056] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:40 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:40.804597 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:40.805119 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:40.807532 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.813738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.814218 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.814657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.815348 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.816513 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.816940 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.821819 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:00:40.833022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 HTTP/1.1 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 11:00:40.834704 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.836505 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '65c4b17d-b0f9-4d24-918e-d1473b531072'} Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:00:40.837485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.839509 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.841608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:00:40.841608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ec97447f-d11e-45a2-9574-4c3906cb7df6 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 404 len: 111 microversion: 2.1 time: 0.035490 Aug 12 11:00:40.841608 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 547/1057] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:00:40 2022] DELETE /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:00:40.845347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:40.846261 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 65c4b17d-b0f9-4d24-918e-d1473b531072] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:40.852519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.853034 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.853472 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.854166 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:40.854621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:40.855048 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:40.869217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 HTTP/1.1 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 11:00:40.870879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.872674 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '65c4b17d-b0f9-4d24-918e-d1473b531072'} Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:00:40.873696 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. Aug 12 11:00:40.875390 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:40.876795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 65c4b17d-b0f9-4d24-918e-d1473b531072 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:00:40.876795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-dfcdcff2-27c7-42e9-a279-a04388cb1e5f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072" status: 404 len: 111 microversion: 2.1 time: 0.031173 Aug 12 11:00:40.876795 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 511/1058] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:40 2022] GET /compute/v2.1/servers/65c4b17d-b0f9-4d24-918e-d1473b531072 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:00:41.291658 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:41.292498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:41.303410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:41.304090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:41.304758 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:41.305715 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:41.306355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:41.306936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:41.450331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:41.465793 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-1ce41fca-e776-4e02-aed1-66ba25650444 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.179089 Aug 12 11:00:41.479870 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 548/1059] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:41 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:42.028514 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:42.029067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:42.036012 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.036545 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.036985 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.037701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.038150 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.038579 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.052820 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d HTTP/1.1 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 11:00:42.054411 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.056019 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': '9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d'} Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:00:42.056933 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.058520 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.060664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:00:42.060664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-cb03244e-1011-46e8-b6a5-7dd9063a3561 tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 404 len: 111 microversion: 2.1 time: 0.031703 Aug 12 11:00:42.060664 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 512/1060] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:00:42 2022] DELETE /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:00:42.064593 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:42.065210 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] [instance: 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:42.071786 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.072315 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.072752 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.073452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.073907 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.074328 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.088006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] HTTP exception thrown: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Request method failure captured: Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d HTTP/1.1 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jHDmHvzUJ-_w9FzpEYXTgwRQgXLI3ZKCkxjKgt0kchSyCcE_4K1Q5x97UXIrUDV4arOZ0d-MVD79GfjMqQAXcpazJN4Dk2aTnf6W1hZ2cFAwrNhInDAImqSMPkiPJPqL7EgtqroPUxJz_heHzus6UOSW-NndRHuiFq4mHB0jSs2bs0 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 11:00:42.089588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_b93ff276e6894c77a231ef075b02ca9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/b93ff276e6894c77a231ef075b02ca9a"}]}] Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: b93ff276e6894c77a231ef075b02ca9a Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-AttachVolumeTestJSON-65485626 Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 5cde581444394ae0b342d0c1ec435c76 Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-AttachVolumeTestJSON-65485626-project Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.091236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d'} Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:00:42.092364 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. Aug 12 11:00:42.094369 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:00:42.095883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] Returning 404 to user: Instance 9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:00:42.095883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-a7cea921-540c-4cfe-9411-b1a218c6051f tempest-AttachVolumeTestJSON-65485626 tempest-AttachVolumeTestJSON-65485626-project] 10.222.0.23 "GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d" status: 404 len: 111 microversion: 2.1 time: 0.030485 Aug 12 11:00:42.095883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 549/1061] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:42 2022] GET /compute/v2.1/servers/9d2cdfd7-ca04-458c-aa8c-1d35b19d2d8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:00:42.488017 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:42.488654 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:42.495037 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.495522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.496025 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.496797 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:42.497221 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:42.497666 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:42.631312 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:42.639026 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a371587b-36a3-4276-98f7-7dab74c42481 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.155075 Aug 12 11:00:42.639593 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 513/1062] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:42 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:43.660187 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:43.660868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:43.668485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:43.669301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:43.669954 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:43.670750 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:43.671556 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:43.672334 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:43.816098 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:43.824411 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5ac47947-808d-4604-bb2d-448ab007fd56 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.168101 Aug 12 11:00:43.825238 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 550/1063] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:43 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:44.850558 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:44.851313 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:44.862949 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:44.864519 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:44.864976 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:44.865719 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:44.866186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:44.866620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:45.044163 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:45.067374 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-0a3c41f1-d912-48c4-9c35-6ccbb536b05d tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.224670 Aug 12 11:00:45.068068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 514/1064] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:44 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:46.088693 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:46.089384 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:46.096391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:46.096967 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:46.097401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:46.098084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:46.098535 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:46.098976 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:46.232696 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:46.240951 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0d7c0dbc-e19e-4ba7-9635-793a99eadffc tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.156281 Aug 12 11:00:46.241508 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 551/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:46 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:47.262778 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:47.263404 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:47.270842 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:47.271388 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:47.271876 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:47.272703 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:47.273214 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:47.273693 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:47.413644 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:47.425508 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-f15f7d68-36ae-48f5-a035-3bbd5f4eef2e tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.166993 Aug 12 11:00:47.426319 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 515/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:47 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:48.450673 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:48.451867 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:48.459321 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:48.459809 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:48.460295 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:48.460960 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:48.461577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:48.461997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:48.603631 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:48.612308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-91700cb8-fb1f-45e3-8386-b049db7acdd1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.165588 Aug 12 11:00:48.612881 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 552/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:48 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:49.641389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:49.642106 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:49.649086 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:49.649592 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:49.650032 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:49.650755 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:49.651799 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:49.652229 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:49.811145 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:49.820496 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a8285539-59fc-49ca-9613-bf749bada8df tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.183156 Aug 12 11:00:49.827367 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 516/1068] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:49 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:50.846390 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:50.847452 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:50.858410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:50.859515 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:50.859980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:50.861006 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:50.861269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:50.861717 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:51.002084 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:51.010281 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-5024458b-d46c-4c39-bcbf-6362dd728514 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.170556 Aug 12 11:00:51.010858 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 553/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:50 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:52.033202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:52.033800 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:52.040961 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:52.041453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:52.041893 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:52.042598 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:52.043062 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:52.043491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:52.182559 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:52.190308 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-03603d33-e805-455b-b9ce-d498fa1bb374 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.161211 Aug 12 11:00:52.190869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 517/1070] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:52 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:53.212568 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:53.213228 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:53.221449 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:53.221929 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:53.222365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:53.223052 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:53.223496 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:53.223912 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:53.369529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:53.377999 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6b350181-4680-4bb5-ab18-1d88e86aacfd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.170184 Aug 12 11:00:53.378549 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 554/1071] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:53 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:54.399603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:54.400224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:54.407133 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:54.407623 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:54.408139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:54.408881 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:54.409336 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:54.409789 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:54.544240 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:54.552429 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-212499e3-a047-4f33-b361-366bff3dae57 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.156716 Aug 12 11:00:54.553022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 518/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:54 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:55.574322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:55.574918 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:55.581891 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.582393 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.582889 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:55.583605 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.584073 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.584543 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:55.734428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:55.742657 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-80c35c3b-26b6-426d-a21a-61d35ee1f34a tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1507 microversion: 2.1 time: 0.172699 Aug 12 11:00:55.743353 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 555/1073] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:55 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:55.764136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:55.764879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:55.771561 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.772047 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.772630 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:55.773219 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.773669 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.774088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:55.816708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132239) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 12 11:00:55.885620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c2aeaa86-291b-4784-8211-b1a547eb51d0 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "POST /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90/action" status: 202 len: 0 microversion: 2.1 time: 0.125475 Aug 12 11:00:55.886435 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 519/1074] 10.222.0.23 () {60 vars in 1278 bytes} [Fri Aug 12 11:00:55 2022] POST /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:00:55.908039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:55.908039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:55.908039 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.908401 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.908700 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:55.909851 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:55.909936 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:55.910363 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:56.064036 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:56.072866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0b88e0f0-58d1-45ad-bf41-beb3da0b83be tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1515 microversion: 2.1 time: 0.177693 Aug 12 11:00:56.073501 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 556/1075] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:55 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:57.095823 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:57.096665 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:57.103905 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:57.104430 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:57.104940 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:57.105660 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:57.106113 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:57.106576 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:57.134858 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "name": "network-vif-unplugged", "status": "completed", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:00:57.153055 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:57.153868 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:57.154536 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:57.176726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.compute.server_external_events [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] Unable to find a host for instance aab4a75f-189f-46c5-ae08-079237c8ca90. Dropping event network-vif-unplugged {{(pid=132240) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 12 11:00:57.178679 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-bf2400f5-4452-49d9-ac39-8aae8c6566a2 req-cffe96bf-6d1e-4b54-992b-064811d0f5f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047581 Aug 12 11:00:57.181056 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 557/1076] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 51 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 12 11:00:57.265638 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:57.274916 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-67a913c3-ca31-4f38-9b2b-a54073bafa02 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1517 microversion: 2.1 time: 0.183331 Aug 12 11:00:57.275573 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 520/1077] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:57 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:58.297057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:58.297672 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:58.304921 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:58.305410 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:58.305843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:58.306555 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:58.306997 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:58.307417 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:58.442743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:58.451042 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-8622dd87-6c3b-48ab-8d1f-bb3a31c9d669 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.157931 Aug 12 11:00:58.451620 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 558/1078] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:58 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:00:59.477364 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:00:59.478581 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:00:59.489522 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:59.490328 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:59.491073 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:59.492385 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:00:59.493375 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:00:59.493896 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:00:59.627966 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:00:59.636479 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-aee6d182-4a87-4f70-adda-528b07911416 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.166020 Aug 12 11:00:59.637053 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 521/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:00:59 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:00.662165 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:00.663190 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:00.674671 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:00.675459 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:00.676178 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:00.677367 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:00.678109 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:00.678839 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:00.817864 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:00.825849 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-08d8c90c-972e-46e8-968a-df66d0a4218f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.170235 Aug 12 11:01:00.826418 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 559/1080] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:00 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:01.851087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:01.851728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:01.859572 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:01.860058 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:01.860538 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:01.861247 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:01.861712 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:01.862146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:01.996055 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:02.003970 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-3cfc7e1d-b7eb-49e2-b74a-5035cb4ad92c tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.159319 Aug 12 11:01:02.004577 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 522/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:01 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:03.028909 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:03.029544 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:03.037286 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:03.037852 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:03.038391 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:03.039199 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:03.039743 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:03.040227 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:03.195068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:03.208292 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-bec63257-816c-4826-8608-ae4980eac1b6 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.185155 Aug 12 11:01:03.208856 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 560/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:03 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:04.230004 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:04.230586 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:04.237705 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:04.238189 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:04.238620 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:04.239319 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:04.239767 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:04.240186 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:04.390202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:04.398420 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e0044960-751a-4845-9098-7d5b8fcd5802 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.172517 Aug 12 11:01:04.399016 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 523/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:04 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:05.421869 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:05.422503 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:05.429461 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:05.429938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:05.430368 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:05.431051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:05.431502 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:05.431918 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:05.572806 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:05.580962 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-48ee5606-fd26-49f8-b0ea-851b6f45b9ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.163063 Aug 12 11:01:05.581529 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 561/1084] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:05 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:06.607478 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:06.608879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:06.620067 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:06.620992 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:06.621846 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:06.622722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:06.623176 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:06.623416 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:06.626202 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:06.760014 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:06.772126 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-70ec6a9b-9772-4520-b160-ffa5b38560ac tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.172190 Aug 12 11:01:06.773022 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 524/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:06 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:07.256001 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "name": "network-vif-plugged", "status": "completed", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:01:07.266958 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:07.267365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:07.267968 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:07.280634 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] Creating event network-vif-plugged:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 11:01:07.285834 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-706514bd-5648-4764-8d03-d9c358a61392 req-4d8a0724-104e-491e-8679-8e14c6d2a05a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033620 Aug 12 11:01:07.286612 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 562/1086] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:01:07.796722 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:07.797346 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:07.804662 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:07.805179 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:07.805636 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:07.806366 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:07.806847 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:07.807298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:07.975616 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:07.985790 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-5796119c-6091-42dc-b700-248d64dbb8c1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1573 microversion: 2.1 time: 0.193609 Aug 12 11:01:07.986356 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 525/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:07 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:09.008904 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:09.009579 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:09.016229 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:09.016738 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:09.017172 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:09.017871 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:09.018322 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:09.018930 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:09.164626 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:09.172361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6e6c3346-620f-4497-a2e6-90ce7feda1a7 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1560 microversion: 2.1 time: 0.168350 Aug 12 11:01:09.172962 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 563/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:09 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:19.737335 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:19.738043 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:19.740245 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.740984 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=11 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.741140 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=33 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.742100 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=85 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:01:19.747701 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:19.748597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:19.749038 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:19.749990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:19.750651 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:19.751092 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:19.781006 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:01:19.808350 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a712a769-28fc-4968-9bbe-56427684e1da", "tag": "639b171d-4ebe-4c62-9438-749ba0ac6881"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:01:19.819174 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:19.820078 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:19.820841 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:19.833090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] Creating event network-changed:639b171d-4ebe-4c62-9438-749ba0ac6881 for instance a712a769-28fc-4968-9bbe-56427684e1da on hv-cinder-85294 Aug 12 11:01:19.838396 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-0e6cd111-1e50-48ce-a86d-85de71cd53f5 req-5ad30773-5ec9-4762-821a-16a82ed48f7d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102943 Aug 12 11:01:19.838998 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 564/1089] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:01:19.871491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-abab4de9-59bb-4d7f-9f54-2cb516cb1559 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 204 len: 0 microversion: 2.1 time: 0.138498 Aug 12 11:01:19.872453 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 526/1090] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:01:19 2022] DELETE /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:01:19.882049 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:19.882984 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:19.889564 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:19.890090 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:19.890582 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:19.891299 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:19.891754 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:19.892177 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:20.034197 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:20.041966 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-140413b0-dc21-4093-b092-44300a8ca3cd tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1577 microversion: 2.1 time: 0.164834 Aug 12 11:01:20.052302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 565/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:19 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:21.066155 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:21.067028 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:21.075377 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:21.076070 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:21.076677 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:21.077547 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:21.078118 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:21.078754 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:21.228775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:21.236935 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-8d90f0e2-cf3e-4ca1-bccc-0e30376c7a1d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1577 microversion: 2.1 time: 0.176232 Aug 12 11:01:21.237647 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 527/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:21 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:22.270628 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:22.271428 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:22.282873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:22.283690 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:22.284547 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:22.285270 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:22.285720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:22.286144 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:22.423775 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:22.432485 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ec9a5513-f720-4287-8372-5498e80f0cb6 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1577 microversion: 2.1 time: 0.168857 Aug 12 11:01:22.433024 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 566/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:22 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:23.457567 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:23.458185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:23.465536 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:23.466042 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:23.466491 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:23.467224 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:23.467702 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:23.468139 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:23.603632 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:23.611304 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-61b8d43b-37f4-481e-a5ed-9c567f54c85f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1577 microversion: 2.1 time: 0.160144 Aug 12 11:01:23.612165 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 528/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:23 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:24.633453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:24.634441 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:24.641236 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:24.641722 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:24.642148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:24.642843 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:24.643311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:24.644163 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:24.789735 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a712a769-28fc-4968-9bbe-56427684e1da", "name": "network-vif-deleted", "tag": "639b171d-4ebe-4c62-9438-749ba0ac6881"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:01:24.792408 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:24.800853 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-25437d4a-0e7a-4497-a011-fc3fa4a53e28 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 200 len: 1459 microversion: 2.1 time: 0.171263 Aug 12 11:01:24.814365 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 567/1095] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:24 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:24.814602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:24.814602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:24.814602 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:24.817551 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] Creating event network-vif-deleted:639b171d-4ebe-4c62-9438-749ba0ac6881 for instance a712a769-28fc-4968-9bbe-56427684e1da on hv-cinder-85294 Aug 12 11:01:24.823599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d1e67d71-331f-497d-b7eb-2f5f7c7989f4 req-7d55ca41-a6ed-469f-aa03-f25d735fd786 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038095 Aug 12 11:01:24.824193 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 529/1096] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:01:25.823510 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:25.824171 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: a712a769-28fc-4968-9bbe-56427684e1da] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:25.830888 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:25.831332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:25.831836 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:25.832560 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:25.833038 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:25.833473 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:25.847048 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] HTTP exception thrown: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Request method failure captured: Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da HTTP/1.1 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jFArV6E_NfUe50aUcuEa1PqnTkNf6ATPt8c4yRp_LwD4wuQZVsUVohC-o2nPIfx0T9AUzg9v0KzDo7153fbRp-G_P9wabUNdutbUd4ONlpbT8hclff6Yyw7WzD3__Gp3YPNrqocAbQpOTGV1vI0FDRCZcNN8SBJuf85oP59PKKaaz0 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 11:01:25.848720 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89943304402242278f5614ea5bde6092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89943304402242278f5614ea5bde6092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}] Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 922f49fa7d324ebdade043e1be1a476f Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. Aug 12 11:01:25.850308 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'a712a769-28fc-4968-9bbe-56427684e1da'} Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:01:25.851239 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. Aug 12 11:01:25.853249 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:25.857269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Returning 404 to user: Instance a712a769-28fc-4968-9bbe-56427684e1da could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:01:25.857269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-6dfc6d93-9801-4723-910b-b5d7cf636a18 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da" status: 404 len: 111 microversion: 2.1 time: 0.030748 Aug 12 11:01:25.857269 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 568/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:25 2022] GET /compute/v2.1/servers/a712a769-28fc-4968-9bbe-56427684e1da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:01:29.399686 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:29.401068 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:29.425498 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:29.427611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:29.428422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:29.430640 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:29.431879 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:29.434495 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:29.467464 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Going to try to terminate instance {{(pid=132239) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:01:29.610339 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-c9814273-0f89-4514-a39b-3ed4ef14ef1c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 204 len: 0 microversion: 2.1 time: 0.215806 Aug 12 11:01:29.611331 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 530/1098] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:01:29 2022] DELETE /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:01:29.621995 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:29.622746 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:29.631862 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:29.632407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:29.632980 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:29.633726 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:29.634208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:29.634697 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:29.668697 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc13a20-172f-4e2b-9b50-deeb09bb9f5c", "tag": "412d82f6-0ea3-41fd-8ac5-5fa4a071ecab"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:01:29.685105 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:29.686094 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:29.686524 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:29.701251 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] Creating event network-changed:412d82f6-0ea3-41fd-8ac5-5fa4a071ecab for instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c on hv-cinder-85294 Aug 12 11:01:29.710302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-9324cd8a-9b64-4e0b-87d2-67a029bb6a2c req-c3aeef6c-27d5-4870-a829-fceba4d64e70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.313173 Aug 12 11:01:29.711438 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 569/1099] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:01:29.820637 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:29.828597 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-7c7ba477-d684-41b7-ac93-1c07e6e8355d tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1577 microversion: 2.1 time: 0.211554 Aug 12 11:01:29.829194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 531/1100] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:29 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 12 11:01:30.856596 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:30.857332 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:30.865570 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:30.866051 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:30.866478 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:30.867166 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:30.867659 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:30.868079 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:31.013020 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:31.021482 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-d60d5589-3a65-4943-ace4-feb5e41a2e8c tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1577 microversion: 2.1 time: 0.172391 Aug 12 11:01:31.022057 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 570/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:30 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:32.043502 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:32.044146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:32.052010 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:32.052783 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:32.053504 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:32.054380 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:32.054986 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:32.055809 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:32.197413 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:32.211208 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a5ce9f23-79dc-4858-a272-547a771c8b6e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1459 microversion: 2.1 time: 0.171615 Aug 12 11:01:32.214621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 532/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:32 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1459 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:32.267068 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc13a20-172f-4e2b-9b50-deeb09bb9f5c", "name": "network-vif-deleted", "tag": "412d82f6-0ea3-41fd-8ac5-5fa4a071ecab"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:01:32.280128 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:32.280624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:32.281022 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:32.293443 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] Creating event network-vif-deleted:412d82f6-0ea3-41fd-8ac5-5fa4a071ecab for instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c on hv-cinder-85294 Aug 12 11:01:32.299185 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-27883ba1-1d82-4814-8372-73e5513fe191 req-5d0326a3-d0e0-486d-a04d-ac4bf5ed46d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035840 Aug 12 11:01:32.300330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 571/1103] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:01:33.236087 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:33.236683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:33.243599 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:33.244095 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:33.244570 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:33.245276 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:33.245744 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:33.246154 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:33.278016 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:33.278497 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:33.278939 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:33.279407 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lazy-loading 'fault' on Instance uuid 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:01:33.320921 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:33.328775 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-34fb5f10-81e6-4a4c-9144-042997fef9e7 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1230 microversion: 2.1 time: 0.096657 Aug 12 11:01:33.329347 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 533/1104] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:33 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:34.353186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:34.353916 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:34.360812 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:34.361303 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:34.361745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:34.362453 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:34.362920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:34.363376 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:34.394588 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:34.395064 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:34.395498 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:34.395944 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.objects.instance [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lazy-loading 'fault' on Instance uuid 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c {{(pid=132240) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:01:34.442655 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:34.450562 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-ef3afe18-e4f1-48e3-9038-1ff359ee7f23 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1230 microversion: 2.1 time: 0.102180 Aug 12 11:01:34.451122 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 572/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:34 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1230 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:35.475990 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:35.477316 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:35.488136 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:35.488683 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:35.489132 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:35.489835 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:35.490298 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:35.490730 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:35.523256 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:35.523729 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:35.524168 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:35.524641 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.objects.instance [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lazy-loading 'fault' on Instance uuid 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c {{(pid=132239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 12 11:01:35.567217 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '922f49fa7d324ebdade043e1be1a476f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89943304402242278f5614ea5bde6092', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:01:35.575051 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-b7b9832c-caca-4108-a3da-989c712fe455 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 200 len: 1230 microversion: 2.1 time: 0.106573 Aug 12 11:01:35.575621 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 534/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:35 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:01:36.596194 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:36.596873 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:36.603745 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:36.604230 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:36.604695 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:36.605395 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:36.605866 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:36.606289 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:36.619729 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] HTTP exception thrown: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Request method failure captured: Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c HTTP/1.1 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jFArV6E_NfUe50aUcuEa1PqnTkNf6ATPt8c4yRp_LwD4wuQZVsUVohC-o2nPIfx0T9AUzg9v0KzDo7153fbRp-G_P9wabUNdutbUd4ONlpbT8hclff6Yyw7WzD3__Gp3YPNrqocAbQpOTGV1vI0FDRCZcNN8SBJuf85oP59PKKaaz0 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 11:01:36.621577 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89943304402242278f5614ea5bde6092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89943304402242278f5614ea5bde6092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}] Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 922f49fa7d324ebdade043e1be1a476f Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. Aug 12 11:01:36.623005 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': '4cc13a20-172f-4e2b-9b50-deeb09bb9f5c'} Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:01:36.623818 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. Aug 12 11:01:36.625129 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:36.626355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Returning 404 to user: Instance 4cc13a20-172f-4e2b-9b50-deeb09bb9f5c could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:01:36.626355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-05cf99a6-7bf0-45ef-99fc-c134098b0ae9 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c" status: 404 len: 111 microversion: 2.1 time: 0.030732 Aug 12 11:01:36.626355 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 573/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:36 2022] GET /compute/v2.1/servers/4cc13a20-172f-4e2b-9b50-deeb09bb9f5c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:01:37.114263 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:37.115088 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:37.124589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:37.125319 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:37.125988 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:37.126917 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:37.127589 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:37.128114 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:37.142473 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] HTTP exception thrown: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Request method failure captured: Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: DELETE /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c HTTP/1.1 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jFArV6E_NfUe50aUcuEa1PqnTkNf6ATPt8c4yRp_LwD4wuQZVsUVohC-o2nPIfx0T9AUzg9v0KzDo7153fbRp-G_P9wabUNdutbUd4ONlpbT8hclff6Yyw7WzD3__Gp3YPNrqocAbQpOTGV1vI0FDRCZcNN8SBJuf85oP59PKKaaz0 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 11:01:37.144184 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89943304402242278f5614ea5bde6092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89943304402242278f5614ea5bde6092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}] Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: 922f49fa7d324ebdade043e1be1a476f Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.145812 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'df47fd0a-3b8e-455b-9302-3f965672841c'} Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:01:37.146607 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.148422 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.149968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Returning 404 to user: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:01:37.149968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-a67e53aa-89db-4a82-b264-262db99d347e tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 404 len: 111 microversion: 2.1 time: 0.037190 Aug 12 11:01:37.149968 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 535/1108] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:01:37 2022] DELETE /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:01:37.155192 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:37.155795 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [instance: df47fd0a-3b8e-455b-9302-3f965672841c] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:01:37.162386 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:37.162865 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:37.163294 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:37.163980 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:01:37.164465 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:01:37.164883 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:01:37.179337 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.wsgi [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] HTTP exception thrown: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Request method failure captured: Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: request: GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c HTTP/1.1 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept: application/json Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Accept-Encoding: identity Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Connection: close Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Length: 0 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Content-Type: application/json Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Host: 10.222.0.23 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Openstack-System-Scope: None Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: User-Agent: python-urllib3/1.26.11 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Auth-Token: gAAAAABi9jFArV6E_NfUe50aUcuEa1PqnTkNf6ATPt8c4yRp_LwD4wuQZVsUVohC-o2nPIfx0T9AUzg9v0KzDo7153fbRp-G_P9wabUNdutbUd4ONlpbT8hclff6Yyw7WzD3__Gp3YPNrqocAbQpOTGV1vI0FDRCZcNN8SBJuf85oP59PKKaaz0 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Id: None Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Domain-Name: None Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Identity-Status: Confirmed Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Is-Admin-Project: True Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Id: default Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Domain-Name: Default Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Project-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Role: reader,member Aug 12 11:01:37.181085 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Roles: reader,member Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/89943304402242278f5614ea5bde6092"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_89943304402242278f5614ea5bde6092"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/89943304402242278f5614ea5bde6092"}]}] Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Id: 89943304402242278f5614ea5bde6092 Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-Tenant-Name: tempest-TestVolumeBootPattern-513807962 Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Id: default Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Domain-Name: Default Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Id: 922f49fa7d324ebdade043e1be1a476f Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: X-User-Name: tempest-TestVolumeBootPattern-513807962-project Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: method: > Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: exception: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.188694 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: action_args: {'id': 'df47fd0a-3b8e-455b-9302-3f965672841c'} Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:01:37.189777 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. Aug 12 11:01:37.192559 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: ERROR nova.api.openstack.wsgi Aug 12 11:01:37.194886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Returning 404 to user: Instance df47fd0a-3b8e-455b-9302-3f965672841c could not be found. {{(pid=132240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:01:37.194886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-146fe56b-4ec9-440a-b338-3d4e624f3a5f tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c" status: 404 len: 111 microversion: 2.1 time: 0.032088 Aug 12 11:01:37.194886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 574/1109] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:01:37 2022] GET /compute/v2.1/servers/df47fd0a-3b8e-455b-9302-3f965672841c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:01:38.509102 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-6aca0825-00c3-40d7-9de5-6f9e96f765b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] Calling method '.version_select at 0x7efc5ca0d310>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:01:38.513646 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6aca0825-00c3-40d7-9de5-6f9e96f765b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [75a32d63-60c1-41a9-acb6-01e5aabba9a7] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 12 11:01:39.522434 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO oslo.messaging._drivers.impl_rabbit [None req-6aca0825-00c3-40d7-9de5-6f9e96f765b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] [75a32d63-60c1-41a9-acb6-01e5aabba9a7] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 33644. Aug 12 11:01:39.545374 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-6aca0825-00c3-40d7-9de5-6f9e96f765b4 tempest-TestVolumeBootPattern-513807962 tempest-TestVolumeBootPattern-513807962-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-902672255" status: 202 len: 0 microversion: 2.1 time: 1.040346 Aug 12 11:01:39.545955 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 536/1110] 10.222.0.23 () {58 vars in 1260 bytes} [Fri Aug 12 11:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-902672255 => generated 0 bytes in 1048 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:02:27.306569 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:02:27.312603 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:27.313125 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:02:27.315472 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_api:SELECT=24 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:27.316148 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG dbcounter [-] [132240] Writing DB stats nova_cell1:SELECT=44 {{(pid=132240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:27.324592 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:27.325074 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:27.325586 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:27.326287 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:27.326732 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:27.327143 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:27.329898 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:27.330682 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG dbcounter [-] [132239] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=132239) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 12 11:02:27.336279 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:27.336756 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:27.337180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:27.353684 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.compute.server_external_events [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] Creating event network-changed:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 11:02:27.361194 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [req-d4beb201-91e7-4d7d-98c7-5931afeb4b77 req-077774e5-f322-4db5-a6a7-a4b7967b6a82 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058490 Aug 12 11:02:27.362370 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 537/1111] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 12 11:02:27.380712 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Going to try to terminate instance {{(pid=132240) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 12 11:02:27.483591 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-49f802e2-8d55-4b05-a546-b7051bc323dd tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "DELETE /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 204 len: 0 microversion: 2.1 time: 0.183202 Aug 12 11:02:27.484624 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 575/1112] 10.222.0.23 () {58 vars in 1239 bytes} [Fri Aug 12 11:02:27 2022] DELETE /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 12 11:02:27.495791 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:27.496546 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:02:27.504708 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:27.505301 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:27.505811 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:27.506534 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:27.507180 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:27.507611 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:27.665146 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:02:27.673185 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-e3bde35b-b6b4-4b58-b0ca-78409f762c18 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.182714 Aug 12 11:02:27.673788 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 538/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:02:27 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:02:28.695311 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:28.696104 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.compute.api [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132240) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:02:28.703783 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:28.704280 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:28.704796 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:28.705466 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:28.705920 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:28.706330 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:28.855554 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.policy [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132240) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:02:28.865909 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-3a9c86b6-4f1e-4473-82ff-0103dd990c8f tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1566 microversion: 2.1 time: 0.175210 Aug 12 11:02:28.866527 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 576/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:02:28 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1566 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:02:29.889121 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:29.889786 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:02:29.896887 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:29.897397 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:29.897859 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:29.898770 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:29.899250 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:29.899661 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:29.975302 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aab4a75f-189f-46c5-ae08-079237c8ca90", "name": "network-vif-deleted", "tag": "20c5afc7-1b44-445f-bb5a-4b82c5078af8"}]} {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 12 11:02:29.986934 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.policy [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f16bdb81c5a249bb9f95e390dbd0dbfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafc312df1404fc6bbc28415bb744411', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132239) authorize /opt/stack/nova/nova/policy.py:199}} Aug 12 11:02:29.988521 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:29.989344 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:29.989930 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG oslo_concurrency.lockutils [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:29.996506 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-85b43dd8-830c-4073-9640-21e006f1fcb1 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 200 len: 1380 microversion: 2.1 time: 0.111852 Aug 12 11:02:29.997428 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 539/1115] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:02:29 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 1380 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 12 11:02:30.003814 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.compute.server_external_events [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] Creating event network-vif-deleted:20c5afc7-1b44-445f-bb5a-4b82c5078af8 for instance aab4a75f-189f-46c5-ae08-079237c8ca90 on hv-cinder-85294 Aug 12 11:02:30.010345 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [req-f6de4d54-b600-44ed-b9a4-a94055f05b0a req-e64b34a7-8a48-48e4-91c7-1faba3a6db4d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039026 Aug 12 11:02:30.011331 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 577/1116] 10.222.0.23 () {64 vars in 1317 bytes} [Fri Aug 12 11:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 12 11:02:31.018987 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '>' {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:31.019614 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.compute.api [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] [instance: aab4a75f-189f-46c5-ae08-079237c8ca90] Fetching instance by UUID {{(pid=132239) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 12 11:02:31.026398 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:31.026885 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:31.027325 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:31.028389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Acquiring lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 12 11:02:31.028849 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 12 11:02:31.029277 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG oslo_concurrency.lockutils [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Lock "cbfddc02-5078-4af6-bce3-a7173079e6ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132239) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 12 11:02:31.046341 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.wsgi [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] HTTP exception thrown: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Request method failure captured: Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: request: GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 HTTP/1.1 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept: application/json Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Accept-Encoding: identity Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Connection: close Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Length: 0 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Content-Type: application/json Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Host: 10.222.0.23 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Openstack-System-Scope: None Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: User-Agent: python-urllib3/1.26.11 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Auth-Token: gAAAAABi9jIx8pKmdB1kGJxNIqIY19Mbx68QsAkOE4Y1beD-aLz7YsKDnme0s10CzCwMlE8Q-UrmYBQBxjrub-gRte5AX5FVduUqzOWeRlm1Lz2FgBrU8Ve2p3Pbwjym_dQuwwljvJomJAYPAyMZd761E4kYc8zSBRua9amJtBm8h7BXPsT3KUI Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Id: None Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Domain-Name: None Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Identity-Status: Confirmed Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Is-Admin-Project: True Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Id: default Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Domain-Name: Default Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Id: fafc312df1404fc6bbc28415bb744411 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Project-Name: tempest-TestShelveInstance-611000882 Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Role: reader,member Aug 12 11:02:31.048159 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Roles: reader,member Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fafc312df1404fc6bbc28415bb744411"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fafc312df1404fc6bbc28415bb744411"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fafc312df1404fc6bbc28415bb744411"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fafc312df1404fc6bbc28415bb744411"}]}] Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant: tempest-TestShelveInstance-611000882 Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Id: fafc312df1404fc6bbc28415bb744411 Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-Tenant-Name: tempest-TestShelveInstance-611000882 Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User: tempest-TestShelveInstance-611000882-project Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Id: default Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Domain-Name: Default Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Id: f16bdb81c5a249bb9f95e390dbd0dbfd Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: X-User-Name: tempest-TestShelveInstance-611000882-project Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: method: > Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: exception: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. Aug 12 11:02:31.049869 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: action_args: {'id': 'aab4a75f-189f-46c5-ae08-079237c8ca90'} Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: {{(pid=132239) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 12 11:02:31.051216 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. Aug 12 11:02:31.053728 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: ERROR nova.api.openstack.wsgi Aug 12 11:02:31.055415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: DEBUG nova.api.openstack.wsgi [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Returning 404 to user: Instance aab4a75f-189f-46c5-ae08-079237c8ca90 could not be found. {{(pid=132239) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 12 11:02:31.055415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO nova.api.openstack.requestlog [None req-d75c7a85-3b85-48dd-aa02-f72e913643c3 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90" status: 404 len: 111 microversion: 2.1 time: 0.035673 Aug 12 11:02:31.055415 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: [pid: 132239|app: 0|req: 540/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Fri Aug 12 11:02:31 2022] GET /compute/v2.1/servers/aab4a75f-189f-46c5-ae08-079237c8ca90 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 12 11:02:31.242782 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: DEBUG nova.api.openstack.wsgi [None req-0d85330e-a0fe-4b53-a35e-f99eb3605644 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] Calling method '.version_select at 0x7efc610b13a0>' {{(pid=132240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 12 11:02:31.266361 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO nova.api.openstack.requestlog [None req-0d85330e-a0fe-4b53-a35e-f99eb3605644 tempest-TestShelveInstance-611000882 tempest-TestShelveInstance-611000882-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-864958502" status: 202 len: 0 microversion: 2.1 time: 0.028733 Aug 12 11:02:31.266938 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: [pid: 132240|app: 0|req: 578/1118] 10.222.0.23 () {58 vars in 1251 bytes} [Fri Aug 12 11:02:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-864958502 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 12 11:03:48.181301 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:03:48.182552 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Fri Aug 12 11:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:03:52.996603 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:03:52.997281 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Fri Aug 12 11:03:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:05:28.876186 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:05:28.877196 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Fri Aug 12 11:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:07:08.193699 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:07:08.195003 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Fri Aug 12 11:07:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:07:13.009005 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:07:13.009965 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Fri Aug 12 11:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:07:13.978148 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:07:13.978533 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Fri Aug 12 11:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:07:29.434389 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:07:29.435369 dv-cinder-852945-1-iscsi devstack@n-api.service[132239]: Fri Aug 12 11:07:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 12 11:07:31.753886 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 12 11:07:31.754726 dv-cinder-852945-1-iscsi devstack@n-api.service[132240]: Fri Aug 12 11:07:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!